GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
EU
Eurus 7b sft
Eurus · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
FA
falcon mamba 7b instruct
Falcon · QuantFactory
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
FA
Falcon
Falcon · QuantFactory
Params6.92B
Context2K
Q4_K_M4.8 GB
GGUF
HE
HelpingAI 3B hindi
Helpingai · QuantFactory
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
LL
Llama 3.2 Taiwan Legal 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
BI
Bielik 7B v0.1
Bielik · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 8B Magpie Pro SFT 300K v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
IN
AlchemistCoder L 7B
InternLM · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
EV
Evolutions Reflex
Evolutionstory · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Hermes 2 Theta Llama 3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
KA
karakuri lm 7b apm v0.2
Karakuri · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TA
TAIDE LX 7B
Taide · QuantFactory
Params6.94B
Context4K
Q4_K_M4.2 GB
GGUF
LL
L3 Umbral Mind RP v3.0 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
ZE
zephyr 7b beta
Zephyr · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama Sentient 3.2 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
PH
Barcenas 14b Phi 3 medium ORPO
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
LL
Llama3 Med42 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Reasoning Llama 1b v0.1
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
Reasoning
LL
Turkish Llama 8b DPO v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
VE
MN 12B Vespa x1
Vespa · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SE
SecurityLLM
Securityllm · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
LLaMAX3 8B Alpaca
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
chinese text correction 7b
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
YI
EVA Yi 1.5 9B 32K V1
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
SO
KoSOLAR 10.7B v0.2
Solar · QuantFactory
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
ST
starcoder2 3b instruct
StarCoder · QuantFactory
Params3.03B
Context16K
Q4_K_M1.9 GB
Coding
LL
llm compiler 7b ftd
Llm · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
DI
DialoGPT medium Loki
Dialogpt · QuantFactory
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GE
Pullulation 2 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen2.5 7B Gutenberg KTO
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
GGUF

Keep browsing