GGUF models by ggml-org

224 GGUF models quantized by ggml-org on Hugging Face. Sizes run from 1M to 1050B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · ggml-org
Params30.5B
Context256K
Q4_K_M18.0 GB
CodingTool use
QW
Qwen2 VL 2B Instruct
Qwen · ggml-org
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
OP
OpenJev
Openjev · ggml-org
Params27B
Context256K
Q4_K_M19.4 GB
Vision
FL
Flint
Flint · ggml-org
Params39.8B
Context256K
Q4_K_M23.4 GB
GGUF
GE
Gemma 3 12b It
Gemma · ggml-org
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
MI
MiMo-V2.6-Flash-RL
Mimo · ggml-org
Params309B
Context1024K
Smallest1.3 GB
Vision
QW
Qwen3 4B
Qwen · ggml-org
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
JU
Julia-1
Julia · ggml-org
Params144M
Context8K
Smallest0.2 GB
GGUF
QW
Qwen3 14B
Qwen · ggml-org
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
NA
vllm-d3-nano
Nano · ggml-org
Params2.4B
Context256K
Smallest2.6 GB
Vision
ST
Step 3.5 Flash
Step · ggml-org
Params197B
Context256K
Smallest118.7 GB
GGUF
QW
Qwen3 Coder Next
Qwen · ggml-org
Params80B
Context256K
Smallest84.8 GB
Coding
LI
LightOnOCR 2 1B
Lightonocr · ggml-org
Params596M
Context16K
Smallest0.6 GB
Vision
GE
Gemma 3 4b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params3.88B
Context128K
Smallest2.5 GB
Vision
NE
NVIDIA-Nemotron-3-Nano-30B-A3B
Nemotron · ggml-org
Params31.6B
Context1024K
Q4_K_M22.4 GB
GGUF
LE
lev
Lev · ggml-org
Params4.2B
Context256K
Q4_K_M3.0 GB
GGUF
LI
vllm-d3-lite
Lite · ggml-org
Params1.01B
Context256K
Smallest1.1 GB
Vision
DE
DeepSeek OCR
DeepSeek · ggml-org
Params2.93B
Context—
Smallest3.1 GB
GGUF
GL
GLM-5.3-Flash
GLM · ggml-org
Params313B
Context1024K
Smallest4.9 GB
Vision
LL
ultravox v0 5 llama 3 2 1b
Llama · ggml-org
Params1.24B
Context128K
Q4_K_M0.8 GB
Vision
QW
MiMo-V2.6-Distill-Qwen-9B
Qwen · ggml-org
Params8.95B
Context256K
Smallest9.5 GB
Vision
MI
MiMo-V2.6-Flash-MOPD
Mimo · ggml-org
Params309B
Context1024K
Smallest1.3 GB
Vision
QW
Qwen3 4B Instruct 2507
Qwen · ggml-org
Params4B
Context256K
Smallest4.3 GB
GGUF
SM
SmolVLM2-256M-Video-Instruct
Smolvlm · ggml-org
Params163M
Context8K
Q4_K_M0.1 GB
Vision
MU
Muse-Glimmer-30B
Muse · ggml-org
Params27.9B
Context128K
Q4_K_M19.2 GB
ReasoningTool useVision
HU
HunyuanOCR
Hunyuanocr · ggml-org
Params539M
Context32K
Smallest0.6 GB
Vision
MO
moondream2
Moondream · ggml-org
Params1.42B
Context2K
Smallest2.8 GB
Vision
KE
Kev 9B
Kev · ggml-org
Params9B
Context256K
Q4_K_M6.4 GB
GGUF
MI
MiMo-V2.6-Pro-RL
Mimo · ggml-org
Params1020B
Context1024K
Smallest2.1 GB
Vision
KI
Kimi VL A3B Thinking 2506
Kimi · ggml-org
Params16B
Context128K
Q4_K_M10.5 GB
ReasoningVision

Keep browsing