GGUF models by unsloth

391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
MI
MiniMax H3
Minimax · unsloth
Params20B
Context—
Q4_K_M18.2 GB
GGUF
QW
Qwen Image 2.1
Qwen · unsloth
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
GE
Gemma-4-12B-It
Gemma · unsloth
Params11.9B
Context256K
Q4_K_M7.1 GB
Vision
QW
Qwen3.5-9B
Qwen · unsloth
Params8.95B
Context256K
Q4_K_M5.7 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · unsloth
Params35.5B
Context256K
Q4_K_M22.7 GB
Vision
QW
Qwen3.5-4B
Qwen · unsloth
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
GE
Gemma-4-26B-A4B-It
Gemma · unsloth
Params25.2B
Context256K
Q4_K_M16.9 GB
Vision
QW
Qwen3.8 Flash Next
Qwen · unsloth
Params177B
Context256K
Q4_K_M1.9 GB
Vision
IM
Z Image Turbo
Image · unsloth
Params6.15B
Context—
Q4_K_M3.9 GB
GGUF
QW
Qwen3.5-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.0 GB
Vision
GL
GLM 5.3 Flash
GLM · unsloth
Params320B
Context1024K
Smallest93.1 GB
Vision
MU
Muse Glimmer 30B
Muse · unsloth
Params27.9B
Context128K
Smallest1.6 GB
Vision
QW
Qwen Image Edit 2511
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
GGUF
QW
Qwen Image 2.1 Turbo
Qwen · unsloth
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
IN
Inkling-Small
Inkling · unsloth
Params264B
Context1024K
Q4_K_M162.5 GB
ReasoningVision
GE
gemma 4 E2B it qat mobile
Gemma · unsloth
Params92M
Context128K
Smallest0.1 GB
Vision
GP
Gpt-Oss-20B
gpt-oss · unsloth
Params20.9B
Context128K
Q4_K_M11.6 GB
GGUF
GE
Gemma-4-E4B-It
Gemma · unsloth
Params7.5B
Context128K
Q4_K_M5.0 GB
Vision
QW
Qwen3-4B
Qwen · unsloth
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
GE
Gemma-4-E2B-It
Gemma · unsloth
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen3-4B-Instruct-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.5-2B
Qwen · unsloth
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
FL
FLUX.2 klein 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.6 GB
GGUF
QW
Qwen3-Vl-4B-Instruct
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
Vision
LT
LTX 2.3
Ltx · unsloth
Params21B
Context—
Q4_K_M14.2 GB
GGUF
FL
FLUX.2 klein 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.7 GB
GGUF
OR
Ornith-1.0-9B
Ornith · unsloth
Params8.95B
Context256K
Q4_K_M5.7 GB
Vision

About unsloth on Hugging Face

unsloth has published 391 GGUF models that ggufmodels.com tracks, across families such as Qwen, Gemma and DeepSeek. The most downloaded are Qwen3.8-27B, MiniMax H3 and Qwen Image 2.1.

The quants unsloth publishes most often are Q8_0 (358), Q4_K_M (357), Q3_K_M (351) and Q5_K_M (350). Their Q4_K_M files range from 0.1 to 629.6 GB. Parameter counts run from 33M to 2780B, and the longest trained context window is 10240K tokens.

Frequently asked questions

What GGUF models has unsloth published?

391 models are listed here, mainly from the Qwen, Gemma and DeepSeek families. The most downloaded is Qwen3.8-27B.

Which quants does unsloth publish?

The most common are Q8_0 (358 models), Q4_K_M (357 models), Q3_K_M (351 models) and Q5_K_M (350 models).

Keep browsing