GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
BA
MN BackyardAI Party 12B v1
Backyardai · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
llama 3.1 8B Thai instruct
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
dolphin 2.9.4 gemma2 2b
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 Ataraxy v3j 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CH
ChatWaifu v1.4
Chatwaifu · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
QW
Rombos LLM V2.5 Qwen 7b
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
MI
Ministral 4b instruct
Mistral · QuantFactory
Params4.42B
Context32K
Q4_K_M2.7 GB
GGUF
LL
Medical Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemmasutra 9B V1B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Replete Coder Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
llama 3 chinese 8b instruct v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
Solar Ko Recovery 11B
Solar · QuantFactory
Params11B
Context4K
Q4_K_M6.6 GB
GGUF
NE
NemoMix Unleashed 12B
Nemomix · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Multilingual SaigaSuzume 8B Classic
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
Memory 9
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
EZO Common T2 2B gemma 2 it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LY
MN 12B Lyra v4a1
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama 3.1 Herrsimian 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
EU
Eurus 2 7B PRIME
Eurus · QuantFactory
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
NE
NemoRemix 12B
Nemoremix · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
HY
HyperLlama3.1 v2
Hyperllama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LU
L3 8B Lunaris v1
Lunaris · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Storm 7B
Storm · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
MN 12B Starcannon v1
Mini · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
KONI Llama3 8B Instruct 20240729
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama3 8B DarkIdol 2.2 Uncensored 1048K
Llama · QuantFactory
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
MI
Flammades Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Awanllm Llama 3 8B Dolfin v1.0
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
mergekit slerp zgbgjeh
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding

Keep browsing