GGUF models by unsloth
391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3-Coder-480B-A35B-Instruct
Qwen · unsloth
Params480B
Context256K
Q4_K_M290.1 GB
NE
Nvidia-Nemotron-3-Super-120B-A12B
Nemotron · unsloth
Params121B
Context1024K
Q4_K_M82.5 GB
GL
Glm-4-32B-0414
GLM · unsloth
Params32.6B
Context32K
Q4_K_M19.7 GB
PH
Phi-4-Reasoning-Plus
Phi · unsloth
Params14.7B
Context32K
Q4_K_M9.1 GB
OR
Orpheus-3B-0.1-Ft
Orpheus · unsloth
Params3.3B
Context128K
Q4_K_M2.1 GB
ER
ERNIE Image Turbo
Ernie · unsloth
Params8.03B
Context—
Q4_K_M5.0 GB
GL
Glm-Z1-9B-0414
GLM · unsloth
Params9.4B
Context32K
Q4_K_M6.2 GB
NE
Nvidia-Nemotron-3-Nano-4B
Nemotron · unsloth
Params3.97B
Context1024K
Q4_K_M2.9 GB
GL
GLM 4.6
GLM · unsloth
Params357B
Context198K
Q4_K_M215.6 GB
MI
Minimax-M2
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
QW
Qwen3-Vl-8B-Thinking
Qwen · unsloth
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · unsloth
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen2.5 Coder 14B Instruct
Qwen · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
FU
Functiongemma-270M-It
Functiongemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
HE
Hermes-4-70B
Hermes · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
AP
Apertus-8B-Instruct-2509
Apertus · unsloth
Params8.05B
Context64K
Q4_K_M5.1 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · unsloth
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3-Vl-235B-A22B-Instruct
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
QW
Qwen3-Vl-4B-Thinking
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
DE
Deepseek-V4-Flash-Vision-Exp
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.4 GB
PH
phi 4
Phi · unsloth
Params14.7B
Context16K
Q4_K_M8.9 GB
DE
Deepseek-V3.2
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
ER
Ernie-4.5-21B-A3B-Pt
Ernie · unsloth
Params21.8B
Context128K
Q4_K_M13.3 GB
MI
Devstral-2-123B-Instruct-2512
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
SE
Seed-Oss-36B-Instruct
Seed · unsloth
Params36.2B
Context512K
Q4_K_M21.8 GB
ME
Medgemma-27B-Text-It
Medgemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
ER
Ernie-4.5-21B-A3B-Thinking
Ernie · unsloth
Params21.8B
Context128K
Q4_K_M13.3 GB
JA
Jan-Nano-128K
Jan · unsloth
Params4B
Context128K
Q4_K_M2.5 GB
GR
Granite-4.0-H-Micro
Granite · unsloth
Params3.2B
Context1024K
Q4_K_M1.9 GB