GGUF models by unsloth
391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek V4 Flash 0731
DeepSeek · unsloth
Params284B
Context—
Smallest10.9 GB
GL
GLM 5.2
GLM · unsloth
Params754B
Context1024K
Q4_K_M465.8 GB
QW
Qwen3-8B
Qwen · unsloth
Params8.19B
Context40K
Q4_K_M5.0 GB
LT
LTX 2.5
Ltx · unsloth
Params21B
Context—
Q4_K_M13.6 GB
GE
gemma 4 E4B it qat
Gemma · unsloth
Params93M
Context128K
Smallest0.1 GB
FL
flux 3 image klein
Flux · unsloth
Params5.55B
Context—
Q4_K_M3.7 GB
QW
Qwen Image
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
PH
Phi 4 Mini Instruct
Phi · unsloth
Params3.84B
Context128K
Q4_K_M2.5 GB
GE
Gemma-3-4B-It
Gemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.5-4B
Qwen · unsloth
Params4.33B
Context256K
Q4_K_M2.8 GB
DE
Deepseek-R1-Distill-Qwen-1.5B
DeepSeek · unsloth
Params1.78B
Context128K
Q4_K_M1.1 GB
GE
Gemma-3-12B-It-Qat
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen3-Vl-2B-Instruct
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
DE
DeepSeek-V4-Pro-0813
DeepSeek · unsloth
Params1570B
Context1024K
Smallest849.7 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · unsloth
Params7.52B
Context128K
Smallest0.0 GB
GE
Gemma-3-270M-It
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
FL
FLUX.2 dev
Flux · unsloth
Params32.2B
Context—
Q4_K_M20.0 GB
FL
FLUX.2 klein base 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.9 GB
MI
Devstral-Small-2-24B-Instruct-2512
Mistral · unsloth
Params23.6B
Context384K
Q4_K_M14.3 GB
QW
Qwen3.5-9B
Qwen · unsloth
Params9.2B
Context256K
Q4_K_M5.9 GB
GE
gemma 4 31B it qat
Gemma · unsloth
Params480M
Context128K
Smallest0.3 GB
GP
Gpt-Oss-120B
gpt-oss · unsloth
Params117B
Context128K
Q4_K_M62.8 GB
QW
Qwen3-Next-80B-A3B-Instruct
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · unsloth
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.5-122B-A10B
Qwen · unsloth
Params125B
Context256K
Q4_K_M78.3 GB
QW
Qwen3-14B
Qwen · unsloth
Params14.8B
Context40K
Q4_K_M9.0 GB
SM
SmolLM2 135M Instruct
SmolLM · unsloth
Params135M
Context8K
Q4_K_M0.1 GB
GE
gemma 4 E2B it qat
Gemma · unsloth
Params4.63B
Context128K
Smallest0.1 GB
QW
Qwen3.6-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M17.1 GB