GGUF models by unsloth

391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash 0731
DeepSeek · unsloth
Params284B
Context—
Smallest10.9 GB
GGUF
GL
GLM 5.2
GLM · unsloth
Params754B
Context1024K
Q4_K_M465.8 GB
GGUF
QW
Qwen3-8B
Qwen · unsloth
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
LT
LTX 2.5
Ltx · unsloth
Params21B
Context—
Q4_K_M13.6 GB
GGUF
GE
gemma 4 E4B it qat
Gemma · unsloth
Params93M
Context128K
Smallest0.1 GB
Vision
FL
flux 3 image klein
Flux · unsloth
Params5.55B
Context—
Q4_K_M3.7 GB
GGUF
QW
Qwen Image
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · unsloth
Params3.84B
Context128K
Q4_K_M2.5 GB
Coding
GE
Gemma-3-4B-It
Gemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
QW
Qwen3.5-4B
Qwen · unsloth
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
DE
Deepseek-R1-Distill-Qwen-1.5B
DeepSeek · unsloth
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
GE
Gemma-3-12B-It-Qat
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Qwen3-Vl-2B-Instruct
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
DE
DeepSeek-V4-Pro-0813
DeepSeek · unsloth
Params1570B
Context1024K
Smallest849.7 GB
GGUF
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · unsloth
Params7.52B
Context128K
Smallest0.0 GB
GGUF
GE
Gemma-3-270M-It
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
FL
FLUX.2 dev
Flux · unsloth
Params32.2B
Context—
Q4_K_M20.0 GB
GGUF
FL
FLUX.2 klein base 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.9 GB
GGUF
MI
Devstral-Small-2-24B-Instruct-2512
Mistral · unsloth
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingVision
QW
Qwen3.5-9B
Qwen · unsloth
Params9.2B
Context256K
Q4_K_M5.9 GB
Vision
GE
gemma 4 31B it qat
Gemma · unsloth
Params480M
Context128K
Smallest0.3 GB
Vision
GP
Gpt-Oss-120B
gpt-oss · unsloth
Params117B
Context128K
Q4_K_M62.8 GB
GGUF
QW
Qwen3-Next-80B-A3B-Instruct
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · unsloth
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
QW
Qwen3.5-122B-A10B
Qwen · unsloth
Params125B
Context256K
Q4_K_M78.3 GB
Vision
QW
Qwen3-14B
Qwen · unsloth
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · unsloth
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
GE
gemma 4 E2B it qat
Gemma · unsloth
Params4.63B
Context128K
Smallest0.1 GB
Vision
QW
Qwen3.6-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M17.1 GB
Vision

Keep browsing