GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
EU
Eurus 7b sft
Eurus · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
falcon mamba 7b instruct
Falcon · QuantFactory
Params7.27B
Context1024K
Q4_K_M4.2 GB
FA
Falcon
Falcon · QuantFactory
Params6.92B
Context2K
Q4_K_M4.8 GB
HE
HelpingAI 3B hindi
Helpingai · QuantFactory
Params2.8B
Context4K
Q4_K_M1.7 GB
LL
Llama 3.2 Taiwan Legal 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
BI
Bielik 7B v0.1
Bielik · QuantFactory
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Llama 3 8B Magpie Pro SFT 300K v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
IN
AlchemistCoder L 7B
InternLM · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
EV
Evolutions Reflex
Evolutionstory · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Hermes 2 Theta Llama 3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
KA
karakuri lm 7b apm v0.2
Karakuri · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
TA
TAIDE LX 7B
Taide · QuantFactory
Params6.94B
Context4K
Q4_K_M4.2 GB
LL
L3 Umbral Mind RP v3.0 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
ZE
zephyr 7b beta
Zephyr · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama Sentient 3.2 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
PH
Barcenas 14b Phi 3 medium ORPO
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.4 GB
LL
Llama3 Med42 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Reasoning Llama 1b v0.1
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Turkish Llama 8b DPO v0.1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
VE
MN 12B Vespa x1
Vespa · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
SE
SecurityLLM
Securityllm · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
LLaMAX3 8B Alpaca
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
QW
chinese text correction 7b
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
YI
EVA Yi 1.5 9B 32K V1
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
SO
KoSOLAR 10.7B v0.2
Solar · QuantFactory
Params10.8B
Context4K
Q4_K_M6.5 GB
ST
starcoder2 3b instruct
StarCoder · QuantFactory
Params3.03B
Context16K
Q4_K_M1.9 GB
LL
llm compiler 7b ftd
Llm · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
DI
DialoGPT medium Loki
Dialogpt · QuantFactory
Params163M
Context1K
Q4_K_M0.1 GB
GE
Pullulation 2 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen2.5 7B Gutenberg KTO
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB