GGUF models by unsloth

391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M17.1 GB
Vision
QW
Qwen2.5 Coder 14B Instruct
Qwen · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
GR
Granite-4.0-H-Small
Granite · unsloth
Params32.2B
Context1024K
Q4_K_M19.6 GB
GGUF
KI
Kimi-K2-Thinking
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
Reasoning
LL
Llama-3_3-Nemotron-Super-49B-V1_5
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
QW
Qwen3-30B-A3B-128K
Qwen · unsloth
Params30.5B
Context128K
Q4_K_M18.6 GB
GGUF
MI
Minimax-M2.5
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
GE
Gemma-3-270M-It-Qat
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GL
Glm-4.1V-9B-Thinking
GLM · unsloth
Params9.4B
Context64K
Q4_K_M6.2 GB
ReasoningVision
HU
Hunyuan-A13B-Instruct
Hunyuan · unsloth
Params80B
Context256K
Q4_K_M48.8 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · unsloth
Params1.54B
Context128K
Q4_K_M1.0 GB
Coding
MI
Mimo-Vl-7B-Rl
Mimo · unsloth
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
DE
DeepSeek V3 0324 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
Coding
QW
Qwen2.5 Coder 3B Instruct
Qwen · unsloth
Params3.09B
Context128K
Q4_K_M1.9 GB
Coding
MI
Mimo-V2.5
Mimo · unsloth
Params310B
Context1024K
Q4_K_M190.9 GB
Vision
BE
Beam 1.0 501B A23B
Beam · unsloth
Params501B
Context—
Smallest0.6 GB
GGUF
QW
Qwen2.5-Vl-72B-Instruct
Qwen · unsloth
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
GL
GLM 4.5
GLM · unsloth
Params358B
Context128K
Q4_K_M216.5 GB
GGUF
QW
Qwen2.5-Vl-32B-Instruct
Qwen · unsloth
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
GL
GLM 5.1
GLM · unsloth
Params754B
Context198K
Q4_K_M464.5 GB
GGUF
KI
Kimi-Dev-72B
Kimi · unsloth
Params72.7B
Context128K
Smallest23.0 GB
Coding
LL
Llama-3.1-Nemotron-Nano-8B-V1
Llama · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · unsloth
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
LF
Lfm2-8B-A1B
Lfm · unsloth
Params8.34B
Context125K
Q4_K_M5.0 GB
GGUF
FA
Falcon-H1-1.5B-Deep-Instruct
Falcon · unsloth
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
QW
Qwen3-14B-128K
Qwen · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwen3-Vl-8B-Thinking-1M
Qwen · unsloth
Params8.19B
Context977K
Q4_K_M5.0 GB
ReasoningVision
OR
Ornith 1.0 397B
Ornith · unsloth
Params397B
Context256K
Q4_K_M245.0 GB
GGUF
AP
Apertus-70B-Instruct-2509
Apertus · unsloth
Params70.6B
Context64K
Q4_K_M43.7 GB
GGUF
GE
gemma 2 it
Gemma · unsloth
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Keep browsing