GGUF models by QuantFactory

1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
CodeQwen1.5 7B Chat
Qwen · QuantFactory
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
LL
LlamaCorn 1.1B Chat
Llama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
GE
Gemma 2 Ifable 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Llama3.2 3B Esper2
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
Coding
LL
Codepy Deepthink 3B
Llama · QuantFactory
Params3.61B
Context128K
Q4_K_M2.2 GB
CodingReasoningTool use
LL
Llama 3.1 8B Ultra Instruct
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 4B
Qwen · QuantFactory
Params4.4B
Context40K
Q4_K_M2.7 GB
GGUF
QW
Qwen3 1.7B
Qwen · QuantFactory
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen2 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
llama 3.1 chinese 8b it dpo
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
SE
SeaLLM3 7B Chat
Seallms · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
CA
CarbonVillain En 10.7B v4
Carbonvillain · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CH
Ph3task3 14B
Chocolatine · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
QW
Qwen2.5 1.5B
Qwen · QuantFactory
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
YI
Yi 1.5 6B
Yi · QuantFactory
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
TA
TableLLM 13b
Tablellm · QuantFactory
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
LL
Llama 3 8B Instruct Gradient 1048k
Llama · QuantFactory
Params8B
Context1024K
Q4_K_M4.9 GB
GGUF
QU
quietstar 8 ahead
Quietstar · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
chinese text correction 1.5b
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
LL
Llama 160m
Llama · QuantFactory
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
LL
Meta Llama 3 70B Instruct GGUF v2
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
XL
xLAM 1b fc r
Xlam · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
Tool use
LL
Llama 3 Ko Luxia Instruct
Llama · QuantFactory
Params8.17B
Context8K
Q4_K_M5.0 GB
GGUF
MI
HannaHermes 2.5 Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
Llama3 TAIDE LX 8B Chat Alpha1
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
KingNish Llama3 8b
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
PH
phi3.5 gutenberg 4B
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
CO
Yi Coder 9B
Coder · QuantFactory
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
CH
Ph3della3 14B
Chocolatine · QuantFactory
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
YI
Faro Yi 9B DPO
Yi · QuantFactory
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF

Keep browsing