GGUF models by unsloth

391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OL
Olmo-3.1-32B-Instruct
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · unsloth
Params218B
Context198K
Q4_K_M132.0 GB
GGUF
LF
Lfm2.5-Vl-1.6B
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
Vision
LL
Llama-3_3-Nemotron-Super-49B-V1
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
Coding
LF
Lfm2-350M
Lfm · unsloth
Params354M
Context32K
Q4_K_M0.2 GB
GGUF
DI
Dictalm-3.0-24B-Thinking
Dictalm · unsloth
Params23.6B
Context64K
Q4_K_M14.3 GB
Reasoning
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · unsloth
Params494M
Context32K
Q4_K_M0.4 GB
Coding
GL
Glm-Z1-32B-0414
GLM · unsloth
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
PH
Phi-4-Reasoning
Phi · unsloth
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
Vision
LF
Lfm2-1.2B
Lfm · unsloth
Params1.17B
Context32K
Q4_K_M0.7 GB
GGUF
ER
Ernie-4.5-0.3B-Pt
Ernie · unsloth
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
QW
Qwen3-Vl-235B-A22B-Thinking
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningVision
IN
Internvl3-8B
Internvl · unsloth
Params7.61B
Context32K
Q4_K_M4.7 GB
CodingVision
DE
Deepseek-Prover-V2-671B-Bf16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.5 GB
Coding
GR
Granite-4.1-30B
Granite · unsloth
Params28.9B
Context128K
Q4_K_M17.5 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · unsloth
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
GR
Granite-4.0-H-350M
Granite · unsloth
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
QW
Qwen3-Vl-235B-A22B-Instruct-1M
Qwen · unsloth
Params235B
Context977K
Q4_K_M142.2 GB
Vision
DO
Dots.Llm1.Inst
Dots · unsloth
Params143B
Context32K
Q4_K_M94.5 GB
GGUF
GP
Gpt-Oss-Safeguard-20B
gpt-oss · unsloth
Params20.9B
Context128K
Q4_K_M11.6 GB
GGUF
FA
Falcon-H1-3B-Instruct
Falcon · unsloth
Params3.15B
Context128K
Q4_K_M1.9 GB
GGUF
QW
Qwen3-Vl-4B-Thinking-1M
Qwen · unsloth
Params4B
Context977K
Q4_K_M2.5 GB
ReasoningVision
QW
Qwen3-Vl-30B-A3B-Thinking-1M
Qwen · unsloth
Params30.5B
Context977K
Q4_K_M18.6 GB
ReasoningVision
QW
Qwen3-16B-A3B
Qwen · unsloth
Params16B
Context40K
Q4_K_M9.8 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct
Qwen · unsloth
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
MI
Mistral Nemo Instruct 2407
Mistral · unsloth
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen3-Vl-4B-Instruct-1M
Qwen · unsloth
Params4B
Context977K
Q4_K_M2.5 GB
Vision
OL
Olmo-3.1-32B-Think
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
QW
Qwen3-Vl-32B-Thinking
Qwen · unsloth
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningVision

Keep browsing