GGUF models by unsloth

391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Ministral-3-8B-Reasoning-2512
Mistral · unsloth
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningVision
MI
MiniMax M3.1 Flash
Minimax · unsloth
Params426B
Context1024K
Smallest0.5 GB
GGUF
FL
flux 3 image klein base
Flux · unsloth
Params5.54B
Context—
Q4_K_M3.6 GB
GGUF
QW
Qwen3-4B-Thinking-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
FL
FLUX.2 klein base 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.4 GB
GGUF
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
Vision
KI
Kimi-K2.5
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
GGUF
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
QW
Qwen3.5-0.8B
Qwen · unsloth
Params773M
Context256K
Q4_K_M0.5 GB
Vision
DE
Deepseek-V3.1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
MU
Muse Spark Open 816B A42B
Muse · unsloth
Params816B
Context—
Smallest0.8 GB
GGUF
NA
Nanonets-Ocr-S
Nanonets · unsloth
Params3.1B
Context125K
Q4_K_M1.9 GB
Vision
MO
MOSS Image Base
Moss · unsloth
Params5.08B
Context—
Q4_K_M3.2 GB
GGUF
EM
Embeddinggemma 300m Qat Q4_0 Unquantized
Embeddinggemma · unsloth
Params303M
Context2K
Smallest0.3 GB
Embedding
MI
Ministral-3-3B-Reasoning-2512
Mistral · unsloth
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningVision
HY
Hy-Mt2-7B
unsloth
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
QW
Qwen3-Coder-30B-A3B-Instruct-1M
Qwen · unsloth
Params30.5B
Context1024K
Q4_K_M18.6 GB
Coding
OR
Ornith 1.0 35B
Ornith · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
Vision
ST
Step-3.7-Flash
Step · unsloth
Params197B
Context256K
Q4_K_M122.1 GB
Vision
QW
Qwen3-235B-A22B
Qwen · unsloth
Params235B
Context40K
Q4_K_M142.2 GB
GGUF
MI
Mistral-Medium-3.5-128B
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
Vision
FL
FLUX.1 Kontext dev
Flux · unsloth
Params11.9B
Context—
Q4_K_M7.4 GB
GGUF
MI
Devstral-Small-2507
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
PH
Phi-4-Mini-Reasoning
Phi · unsloth
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoning
QW
Qwen3-Vl-2B-Thinking
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
ReasoningVision
MI
Minimax-M3
Minimax · unsloth
Params426B
Context1024K
Q4_K_M264.9 GB
Vision
QW
Qwen3-235B-A22B-Instruct-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
GGUF
GL
GLM 5
GLM · unsloth
Params754B
Context198K
Q4_K_M455.9 GB
GGUF
GL
Glm-4-9B-0414
GLM · unsloth
Params9.4B
Context32K
Q4_K_M6.2 GB
GGUF
MI
Ministral-3-14B-Reasoning-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningVision

Keep browsing