GGUF models by unsloth
391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.
OL
Olmo-3.1-32B-Instruct
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · unsloth
Params218B
Context198K
Q4_K_M132.0 GB
LF
Lfm2.5-Vl-1.6B
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
LL
Llama-3_3-Nemotron-Super-49B-V1
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
LF
Lfm2-350M
Lfm · unsloth
Params354M
Context32K
Q4_K_M0.2 GB
DI
Dictalm-3.0-24B-Thinking
Dictalm · unsloth
Params23.6B
Context64K
Q4_K_M14.3 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · unsloth
Params494M
Context32K
Q4_K_M0.4 GB
GL
Glm-Z1-32B-0414
GLM · unsloth
Params32.6B
Context32K
Q4_K_M19.7 GB
PH
Phi-4-Reasoning
Phi · unsloth
Params14.7B
Context32K
Q4_K_M9.1 GB
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
LF
Lfm2-1.2B
Lfm · unsloth
Params1.17B
Context32K
Q4_K_M0.7 GB
ER
Ernie-4.5-0.3B-Pt
Ernie · unsloth
Params361M
Context128K
Q4_K_M0.2 GB
QW
Qwen3-Vl-235B-A22B-Thinking
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
IN
Internvl3-8B
Internvl · unsloth
Params7.61B
Context32K
Q4_K_M4.7 GB
DE
Deepseek-Prover-V2-671B-Bf16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.5 GB
GR
Granite-4.1-30B
Granite · unsloth
Params28.9B
Context128K
Q4_K_M17.5 GB
SM
SmolLM2 1.7B Instruct
SmolLM · unsloth
Params1.71B
Context8K
Q4_K_M1.1 GB
GR
Granite-4.0-H-350M
Granite · unsloth
Params340M
Context1024K
Q4_K_M0.2 GB
QW
Qwen3-Vl-235B-A22B-Instruct-1M
Qwen · unsloth
Params235B
Context977K
Q4_K_M142.2 GB
DO
Dots.Llm1.Inst
Dots · unsloth
Params143B
Context32K
Q4_K_M94.5 GB
GP
Gpt-Oss-Safeguard-20B
gpt-oss · unsloth
Params20.9B
Context128K
Q4_K_M11.6 GB
FA
Falcon-H1-3B-Instruct
Falcon · unsloth
Params3.15B
Context128K
Q4_K_M1.9 GB
QW
Qwen3-Vl-4B-Thinking-1M
Qwen · unsloth
Params4B
Context977K
Q4_K_M2.5 GB
QW
Qwen3-Vl-30B-A3B-Thinking-1M
Qwen · unsloth
Params30.5B
Context977K
Q4_K_M18.6 GB
QW
Qwen3-16B-A3B
Qwen · unsloth
Params16B
Context40K
Q4_K_M9.8 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · unsloth
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
Mistral Nemo Instruct 2407
Mistral · unsloth
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3-Vl-4B-Instruct-1M
Qwen · unsloth
Params4B
Context977K
Q4_K_M2.5 GB
OL
Olmo-3.1-32B-Think
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
QW
Qwen3-Vl-32B-Thinking
Qwen · unsloth
Params32.8B
Context256K
Q4_K_M19.8 GB