GGUF models by maddes8cht
88 GGUF models quantized by maddes8cht on Hugging Face. Sizes run from 1.59B to 41.9B parameters. The longest trained context is 64K tokens.
ST
StableLM-3b-EssayWriter
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
HA
harborwater wizard orca 3b
Harborwater · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
LL
georgesung open llama 7b qlora uncensored
Llama · maddes8cht
Params6.74B
Context2K
Q4_K_M4.1 GB
RE
Refact
Refact · maddes8cht
Params1.59B
Context4K
Q4_K_M1.0 GB
DI
Dimensity-3B
Dimensity · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
LL
syzymon long llama 3b v1 1
Llama · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
ST
stablelm-3b-4e1t
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
PE
persimmon-8b-chat
Persimmon · maddes8cht
Params9.4B
Context16K
Q4_K_M6.1 GB
GO
gorilla-mpt-7b-hf-v0
Gorilla · maddes8cht
Params6.86B
Context2K
Q4_K_M4.4 GB
MO
mosaicml mpt 7b
Mosaicml · maddes8cht
Params6.86B
Context2K
Q4_K_M4.4 GB
MP
mpt-7b-storywriter
Mpt · maddes8cht
Params6.86B
Context64K
Q4_K_M4.4 GB
AD
adept persimmon 8b base
Adept · maddes8cht
Params9.4B
Context16K
Q4_K_M6.1 GB
AI
airoboros-3b-3p11
Airoboros · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
FA
Falcon
Falcon · maddes8cht
Params41.9B
Context2K
Smallest23.9 GB
JA
japanese-stablelm-3b-4e1t-instruct
Japanese · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
AC
acrastt OmegLLaMA 3B
Acrastt · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
KN
KnutJaegersberg openllama 3b EvolInstruct lora merged
Knutjaegersberg · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
FA
Falcon
Falcon · maddes8cht
Params41.8B
Context2K
Q4_K_M25.5 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
MP
mpt-30b-v3
Mpt · maddes8cht
Params30.3B
Context8K
Q4_K_M19.3 GB
MP
mpt-7b-instruct
Mpt · maddes8cht
Params6.86B
Context2K
Q4_K_M4.4 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
FA
Falcon
Falcon · maddes8cht
Params7.26B
Context2K
Q4_K_M5.0 GB
ST
rocket-3B
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
LL
syzymon long llama 3b
Llama · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB
FA
Falcon
Falcon · maddes8cht
Params7.22B
Context2K
Q4_K_M5.0 GB