GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
TR
Triplex
Triplex · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
Fireball 3.1 8B ORPO
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Fei v1 Uncensored
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
QW
qwen2.5 reinstruct alternate lumen 14B
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB
WI
WizardLM 13B Uncensored
Wizardlm · QuantFactory
Params13B
Context2K
Q4_K_M7.9 GB
LL
Meta Llama 3 8B Instruct GGUF v2
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GR
granite 7b lab
Granite · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama3.2 3B Enigma
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
philosophy mistral
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
MAmmoTH2 7B
Mammoth · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GH
Ghost 7b Alpha
Ghost · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
PE
Peach 9B 8k Roleplay
Peach · QuantFactory
Params8.8B
Context16K
Q4_K_M5.3 GB
LL
llama 3 sqlcoder 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
DE
DeepScaleR 1.5B Preview
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
emma 500 llama2 7b
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.2 1B
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
MI
Ministral 3b instruct
Mistral · QuantFactory
Params3.32B
Context128K
Q4_K_M2.0 GB
DA
arco reflection v4
Danube · QuantFactory
Params514M
Context8K
Q4_K_M0.3 GB
QW
Josiefied Qwen2.5 7B Instruct Abliterated
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
RE
reader lm 1.5b
Reader · QuantFactory
Params1.78B
Context250K
Q4_K_M1.1 GB
LU
L3 bluuwhale SAO MIX 8B V1 fp32 merge calc
Lunaris · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
MI
Mistral 7B Instruct RDPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
minecraft
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen3 Reranker 4B
Qwen · QuantFactory
Params4.4B
Context40K
Q4_K_M2.7 GB
YI
dolphin 2.9.1 yi 1.5 9b
Yi · QuantFactory
Params8.83B
Context12K
Q4_K_M5.3 GB
UM
Umievo itr012 Gleipnir 7B
Umievo · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
CodeLlama 7B Kexer
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Einstein v6.1 Llama3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 14B
Qwen · QuantFactory
Params14.8B
Context32K
Q4_K_M9.0 GB