GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
TR
Triplex
Triplex · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
Fireball 3.1 8B ORPO
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
qwen2.5 reinstruct alternate lumen 14B
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
WI
WizardLM 13B Uncensored
Wizardlm · QuantFactory
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LL
Meta Llama 3 8B Instruct GGUF v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GR
granite 7b lab
Granite · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama3.2 3B Enigma
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
Coding
MI
philosophy mistral
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
MAmmoTH2 7B
Mammoth · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
GH
Ghost 7b Alpha
Ghost · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
PE
Peach 9B 8k Roleplay
Peach · QuantFactory
Params8.8B
Context16K
Q4_K_M5.3 GB
Roleplay
LL
llama 3 sqlcoder 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Coding
DE
DeepScaleR 1.5B Preview
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
LL
emma 500 llama2 7b
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama 3.2 1B
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
MI
Ministral 3b instruct
Mistral · QuantFactory
Params3.32B
Context128K
Q4_K_M2.0 GB
GGUF
DA
arco reflection v4
Danube · QuantFactory
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
QW
Josiefied Qwen2.5 7B Instruct Abliterated
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
RE
reader lm 1.5b
Reader · QuantFactory
Params1.78B
Context250K
Q4_K_M1.1 GB
GGUF
LU
L3 bluuwhale SAO MIX 8B V1 fp32 merge calc
Lunaris · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral 7B Instruct RDPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
minecraft
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Qwen3 Reranker 4B
Qwen · QuantFactory
Params4.4B
Context40K
Q4_K_M2.7 GB
Embedding
YI
dolphin 2.9.1 yi 1.5 9b
Yi · QuantFactory
Params8.83B
Context12K
Q4_K_M5.3 GB
CodingTool use
UM
Umievo itr012 Gleipnir 7B
Umievo · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
CodeLlama 7B Kexer
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Einstein v6.1 Llama3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
QW
Qwen2.5 Coder 14B
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding

Keep browsing