GGUF models by QuantFactory
1418 GGUF models quantized by QuantFactory on Hugging Face. Sizes run from 9M to 225B parameters. The longest trained context is 4194304K tokens.
QW
Qwen2.5 1.5B Instruct
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
DE
deepseek coder 1.3B kexer
DeepSeek · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
DE
deepseek coder 6.7b instruct
DeepSeek · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
NS
NSFW 3B
Nsfw · QuantFactory
Params2.8B
Context4K
Q4_K_M1.7 GB
QW
dolphin 2.9.2 qwen2 7b
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
ST
starcoder2-15b
StarCoder · QuantFactory
Params16B
Context16K
Q4_K_M9.9 GB
LL
CodeLlama 7b Instruct hf
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
Qwen2.5 Coder 1.5B
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GR
granite 3.1 2b instruct
Granite · QuantFactory
Params2.63B
Context128K
Q4_K_M1.6 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
LL
Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
ST
L3 SthenoMaidBlackroot 8B V1
Sthenomaidblackroot · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Qwen 14B abliterated v2
DeepSeek · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · QuantFactory
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Qwen2.5 7B Instruct
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
CO
Yi Coder 1.5B
Coder · QuantFactory
Params1.48B
Context128K
Q4_K_M1.0 GB
LL
Llama 7b
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
CodeLlama 7B KStack clean
Llama · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
Qwen2.5 3B Instruct
Qwen · QuantFactory
Params3.1B
Context32K
Q4_K_M1.9 GB
GL
LongWriter Glm4 9b
GLM · QuantFactory
Params9.4B
Context1024K
Q4_K_M6.3 GB
LL
Llama2 7B Hindi finetuned
Llama · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
PY
pythia 160m
Pythia · QuantFactory
Params162M
Context2K
Q4_K_M0.1 GB
QW
Qwen3 0.6B
Qwen · QuantFactory
Params752M
Context40K
Q4_K_M0.5 GB
LL
Llama 3.2 1B Instruct
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
DE
deepseek coder 6.7B kexer
DeepSeek · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
ST
starcoder2 7b
StarCoder · QuantFactory
Params7.2B
Context16K
Q4_K_M4.5 GB
QW
Meissa Qwen2.5 7B Instruct
Qwen · QuantFactory
Params7.6B
Context32K
Q4_K_M4.7 GB
ST
Starcoder2 7b
StarCoder · QuantFactory
Params7.17B
Context16K
Q4_K_M4.5 GB