GGUF models by unsloth

391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
WA
Wan2.2 TI2V 5B
Wan · unsloth
Params5B
Context—
Q4_K_M3.4 GB
GGUF
QW
Qwen3.6-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.8 GB
Vision
GL
GLM 5.3
GLM · unsloth
Params754B
Context1024K
Smallest216.7 GB
GGUF
QW
Qwen Image 2512
Qwen · unsloth
Params20.4B
Context—
Q4_K_M13.3 GB
GGUF
IN
TML Inkling
Inkling · unsloth
Params950B
Context1024K
Smallest270.2 GB
ReasoningVision
KI
Kimi-K3
Kimi · unsloth
Params2780B
Context1024K
Smallest466.4 GB
Vision
GE
Gemma-4-31B-It
Gemma · unsloth
Params30.7B
Context256K
Q4_K_M18.3 GB
Vision
QW
Qwen3.5-0.8B
Qwen · unsloth
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen-Agentworld-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
GGUF
QW
Qwen2.5-Vl-7B-Instruct
Qwen · unsloth
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
GL
Glm-4.7-Flash
GLM · unsloth
Params30B
Context198K
Q4_K_M18.3 GB
GGUF
NO
North-Mini-Code-1.0
North · unsloth
Params30.5B
Context488K
Q4_K_M19.2 GB
Coding
DE
DeepSeek V4.1 Flash 1017
DeepSeek · unsloth
Params748B
Context1024K
Smallest8.0 GB
GGUF
QW
Qwen3-1.7B
Qwen · unsloth
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
GE
gemma 4 12B it qat
Gemma · unsloth
Params440M
Context256K
Smallest0.3 GB
Vision
BG
bge small en v1.5
BGE · unsloth
Params33M
Context512
Smallest0.1 GB
Embedding
QW
Qwen3-Vl-8B-Instruct
Qwen · unsloth
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
FL
Flint Preview
Flint · unsloth
Params39.8B
Context256K
Smallest11.4 GB
GGUF
GE
gemma 4 26B A4B it qat
Gemma · unsloth
Params430M
Context128K
Smallest0.3 GB
Vision
LF
LFM2.5-24B-A2B-Preview
Lfm · unsloth
Params24B
Context128K
Smallest7.5 GB
GGUF
QW
Qwen3.5-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.7 GB
Vision
LL
Llama-3.2-3B-Instruct
Llama · unsloth
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
OR
Ornith 1.5 122B
Ornith · unsloth
Params125B
Context256K
Smallest40.4 GB
Vision
DE
Deepseek-R1-0528-Qwen3-8B
DeepSeek · unsloth
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
IM
Z Image
Image · unsloth
Params6.15B
Context—
Q4_K_M3.9 GB
GGUF
QW
Qwen3-Coder-Next
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
Coding
QW
Qwen3-0.6B
Qwen · unsloth
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
KI
Kimi-K2.7-Code
Kimi · unsloth
Params1030B
Context256K
Smallest303.9 GB
CodingVision
EM
Embeddinggemma 2
Embeddinggemma · unsloth
Params271M
Context256K
Smallest0.2 GB
EmbeddingVision

Keep browsing