GGUF models by unsloth
391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek R1 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B
Nemotron · unsloth
Params1.63B
Context1024K
Smallest1.3 GB
QW
Qwen2.5-Vl-3B-Instruct
Qwen · unsloth
Params3.09B
Context125K
Q4_K_M1.9 GB
GL
Glm-4.6V
GLM · unsloth
Params107B
Context128K
Q4_K_M70.6 GB
MI
Ministral-3-3B-Instruct-2512
Mistral · unsloth
Params3.43B
Context256K
Q4_K_M2.1 GB
QW
Qwen Image Layered
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
DE
Deepseek-V4-Flash
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.5 GB
QW
Qwen3-Vl-32B-Instruct
Qwen · unsloth
Params32.8B
Context256K
Q4_K_M19.8 GB
GL
cerebras/GLM-4.7-Flash-REAP-23B-A3B
GLM · unsloth
Params23B
Context198K
Q4_K_M14.1 GB
QW
Qwen3-Vl-30B-A3B-Instruct
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
MI
Mistral-Small-4-119B-2603
Mistral · unsloth
Params119B
Context1024K
Q4_K_M73.8 GB
LF
Lfm2.5-8B-A1B
Lfm · unsloth
Params8.47B
Context125K
Q4_K_M5.3 GB
LF
Lfm2.5-Vl-3B
Lfm · unsloth
Params2.7B
Context125K
Q4_K_M1.7 GB
QW
Qwen3.5-397B-A17B
Qwen · unsloth
Params397B
Context256K
Q4_K_M244.1 GB
MI
Ministral-3-8B-Instruct-2512
Mistral · unsloth
Params8.49B
Context256K
Q4_K_M5.2 GB
QW
Qwen3.5-2B
Qwen · unsloth
Params1.94B
Context256K
Q4_K_M1.3 GB
GE
Gemma-3-4B-It-Qat
Gemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
GL
GLM 4.7
GLM · unsloth
Params358B
Context198K
Q4_K_M216.5 GB
FL
flux 3 image klein pup
Flux · unsloth
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama-3.1-8B-Instruct
Llama · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
KI
Kimi-K2-Instruct
Kimi · unsloth
Params1030B
Context128K
Q4_K_M620.8 GB
QW
Qwen2.5-Omni-7B
Qwen · unsloth
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen Image Edit 2509
Qwen · unsloth
Params20.4B
Context—
Q4_K_M12.8 GB
MI
Ministral-3-14B-Instruct-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB
QW
Qwen3.5-35B-A3B
Qwen · unsloth
Params35.5B
Context256K
Q4_K_M22.6 GB
ME
Medgemma-1.5-4B-It
Medgemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
DE
Deepseek-R1-0528
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
LA
Laguna-S-2.1
Laguna · unsloth
Params118B
Context256K
Q4_K_M73.1 GB
SM
Smollm3-3B
SmolLM · unsloth
Params3.08B
Context64K
Q4_K_M1.9 GB
NE
Nvidia-Nemotron-3-Nano-Omni-30B-A3B-Reasoning
Nemotron · unsloth
Params31.6B
Context1024K
Q4_K_M23.9 GB