GGUF models by unsloth
391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.
MI
Ministral-3-8B-Reasoning-2512
Mistral · unsloth
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
MiniMax M3.1 Flash
Minimax · unsloth
Params426B
Context1024K
Smallest0.5 GB
FL
flux 3 image klein base
Flux · unsloth
Params5.54B
Context—
Q4_K_M3.6 GB
QW
Qwen3-4B-Thinking-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
FL
FLUX.2 klein base 4B
Flux · unsloth
Params3.88B
Context—
Q4_K_M2.4 GB
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
KI
Kimi-K2.5
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.5-0.8B
Qwen · unsloth
Params773M
Context256K
Q4_K_M0.5 GB
DE
Deepseek-V3.1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
MU
Muse Spark Open 816B A42B
Muse · unsloth
Params816B
Context—
Smallest0.8 GB
NA
Nanonets-Ocr-S
Nanonets · unsloth
Params3.1B
Context125K
Q4_K_M1.9 GB
MO
MOSS Image Base
Moss · unsloth
Params5.08B
Context—
Q4_K_M3.2 GB
EM
Embeddinggemma 300m Qat Q4_0 Unquantized
Embeddinggemma · unsloth
Params303M
Context2K
Smallest0.3 GB
MI
Ministral-3-3B-Reasoning-2512
Mistral · unsloth
Params3.43B
Context256K
Q4_K_M2.1 GB
HY
Hy-Mt2-7B
unsloth
Params7.5B
Context256K
Q4_K_M4.6 GB
QW
Qwen3-Coder-30B-A3B-Instruct-1M
Qwen · unsloth
Params30.5B
Context1024K
Q4_K_M18.6 GB
OR
Ornith 1.0 35B
Ornith · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
ST
Step-3.7-Flash
Step · unsloth
Params197B
Context256K
Q4_K_M122.1 GB
QW
Qwen3-235B-A22B
Qwen · unsloth
Params235B
Context40K
Q4_K_M142.2 GB
MI
Mistral-Medium-3.5-128B
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
FL
FLUX.1 Kontext dev
Flux · unsloth
Params11.9B
Context—
Q4_K_M7.4 GB
MI
Devstral-Small-2507
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
PH
Phi-4-Mini-Reasoning
Phi · unsloth
Params3.84B
Context128K
Q4_K_M2.5 GB
QW
Qwen3-Vl-2B-Thinking
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
MI
Minimax-M3
Minimax · unsloth
Params426B
Context1024K
Q4_K_M264.9 GB
QW
Qwen3-235B-A22B-Instruct-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
GL
GLM 5
GLM · unsloth
Params754B
Context198K
Q4_K_M455.9 GB
GL
Glm-4-9B-0414
GLM · unsloth
Params9.4B
Context32K
Q4_K_M6.2 GB
MI
Ministral-3-14B-Reasoning-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB