GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
QW
CodeQwen1.5 7B Chat
Qwen · QuantFactory
Params7.25B
Context64K
Q4_K_M4.7 GB
LL
LlamaCorn 1.1B Chat
Llama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
GE
Gemma 2 Ifable 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama3.2 3B Esper2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Codepy Deepthink 3B
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
LL
Llama 3.1 8B Ultra Instruct
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 4B
Qwen · QuantFactory
Params4.4B
Context40K
Q4_K_M2.7 GB
QW
Qwen3 1.7B
Qwen · QuantFactory
Params2.03B
Context40K
Q4_K_M1.3 GB
QW
Qwen2 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
llama 3.1 chinese 8b it dpo
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
SE
SeaLLM3 7B Chat
Seallms · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
CA
CarbonVillain En 10.7B v4
Carbonvillain · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
CH
Ph3task3 14B
Chocolatine · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
QW
Qwen2.5 1.5B
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
YI
Yi 1.5 6B
Yi · QuantFactory
Params6.06B
Context4K
Q4_K_M3.7 GB
TA
TableLLM 13b
Tablellm · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
LL
Llama 3 8B Instruct Gradient 1048k
Llama · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
QU
quietstar 8 ahead
Quietstar · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
chinese text correction 1.5b
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama 160m
Llama · QuantFactory
Params162M
Context2K
Q4_K_M0.1 GB
LL
Meta Llama 3 70B Instruct GGUF v2
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
XL
xLAM 1b fc r
Xlam · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
Llama 3 Ko Luxia Instruct
Llama · QuantFactory
Params8.17B
Context8K
Q4_K_M5.0 GB
MI
HannaHermes 2.5 Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama3 TAIDE LX 8B Chat Alpha1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
KingNish Llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
PH
phi3.5 gutenberg 4B
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
CO
Yi Coder 9B
Coder · QuantFactory
Params8.83B
Context128K
Q4_K_M5.3 GB
CH
Ph3della3 14B
Chocolatine · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
YI
Faro Yi 9B DPO
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB