GGUF models by unsloth
391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.
GE
gemma 4 E4B it qat mobile
Gemma · unsloth
Params7.46B
Context128K
Smallest0.1 GB
GE
Gemma-3-12B-It
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B
Nemotron · unsloth
Params74B
Context256K
Smallest1.0 GB
GE
Gemma-3N-E2B-It
Gemma · unsloth
Params4.46B
Context32K
Q4_K_M3.0 GB
QW
Qwen3-32B
Qwen · unsloth
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3.5-122B-A10B
Qwen · unsloth
Params122B
Context256K
Q4_K_M76.5 GB
GE
Gemma-3-1B-It
Gemma · unsloth
Params1B
Context32K
Q4_K_M0.8 GB
FL
FLUX.1 schnell
Flux · unsloth
Params11.9B
Context—
Q4_K_M7.4 GB
MO
MOSS Image SFT
Moss · unsloth
Params5.08B
Context—
Q4_K_M3.2 GB
NE
Nvidia-Nemotron-3.5-Lightning-30B-A3B
Nemotron · unsloth
Params32.9B
Context1024K
Q4_K_M25.3 GB
QW
Qwen3-30B-A3B
Qwen · unsloth
Params30.5B
Context40K
Q4_K_M18.6 GB
LL
Llama-3.2-1B-Instruct
Llama · unsloth
Params1.24B
Context128K
Q4_K_M0.8 GB
GL
Glm-4.5-Air
GLM · unsloth
Params110B
Context128K
Q4_K_M73.0 GB
DE
Deepseek-R1-Distill-Llama-8B
DeepSeek · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
FL
FLUX.1 dev
Flux · unsloth
Params11.9B
Context—
Q4_K_M6.9 GB
LT
LTX 2
Ltx · unsloth
Params18.9B
Context—
Q4_K_M12.8 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
Llama-4-Scout-17B-16E-Instruct
Llama · unsloth
Params108B
Context10240K
Q4_K_M65.4 GB
GL
Glm-4.6V-Flash
GLM · unsloth
Params9.4B
Context128K
Q4_K_M6.2 GB
DE
Deepseek-R1-Distill-Llama-70B
DeepSeek · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Nemotron-3-Nano-30B-A3B
Nemotron · unsloth
Params31.6B
Context1024K
Q4_K_M24.6 GB
GE
Gemma-3-27B-It
Gemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma-3N-E4B-It
Gemma · unsloth
Params6.9B
Context32K
Q4_K_M4.5 GB
LF
Lfm2.5-1.2B-Instruct
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
DI
diffusiongemma 26B A4B it
Diffusiongemma · unsloth
Params25.3B
Context256K
Q4_K_M16.8 GB
LL
Llama-3.3-70B-Instruct
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
ME
Medgemma-4B-It
Medgemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3-Next-80B-A3B-Thinking
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
MI
Mimo-V2-Flash
Mimo · unsloth
Params310B
Context256K
Q4_K_M186.8 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB