GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
BA
MN BackyardAI Party 12B v1
Backyardai · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
llama 3.1 8B Thai instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
dolphin 2.9.4 gemma2 2b
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 2 Ataraxy v3j 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
CH
ChatWaifu v1.4
Chatwaifu · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Rombos LLM V2.5 Qwen 7b
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
Ministral 4b instruct
Mistral · QuantFactory
Params4.42B
Context32K
Q4_K_M2.7 GB
LL
Medical Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemmasutra 9B V1B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Replete Coder Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama 3 chinese 8b instruct v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
Solar Ko Recovery 11B
Solar · QuantFactory
Params11B
Context4K
Q4_K_M6.6 GB
NE
NemoMix Unleashed 12B
Nemomix · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Multilingual SaigaSuzume 8B Classic
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Memory 9
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
EZO Common T2 2B gemma 2 it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
LY
MN 12B Lyra v4a1
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3.1 Herrsimian 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
EU
Eurus 2 7B PRIME
Eurus · QuantFactory
Params7.62B
Context4K
Q4_K_M4.7 GB
NE
NemoRemix 12B
Nemoremix · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
HY
HyperLlama3.1 v2
Hyperllama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LU
L3 8B Lunaris v1
Lunaris · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Storm 7B
Storm · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
MN 12B Starcannon v1
Mini · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
KONI Llama3 8B Instruct 20240729
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
llama3 8B DarkIdol 2.2 Uncensored 1048K
Llama · QuantFactory
Params8.03B
Context1024K
Q4_K_M4.9 GB
MI
Flammades Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Awanllm Llama 3 8B Dolfin v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
mergekit slerp zgbgjeh
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB