GGUF models by ggml-org

224 GGUF models quantized by ggml-org on Hugging Face. Sizes run from 1M to 1050B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 1.5B
Qwen · ggml-org
Params1.54B
Context32K
Smallest1.6 GB
Coding
GE
Gemma 3 270m Qat Q4_0 Unquantized
Gemma · ggml-org
Params268M
Context32K
Smallest0.2 GB
GGUF
QW
Qwen3.5 35B A3B
Qwen · ggml-org
Params34.7B
Context256K
Smallest36.9 GB
Vision
DO
dots.ocr
Dots · ggml-org
Params1.78B
Context128K
Smallest1.9 GB
Vision
GE
Gemma 3 270m It Qat Q4_0 Unquantized
Gemma · ggml-org
Params268M
Context32K
Smallest0.2 GB
GGUF
KE
Kev-0.8B
Kev · ggml-org
Params753M
Context256K
Smallest0.8 GB
GGUF
GE
Gemma 3 270m It
Gemma · ggml-org
Params268M
Context32K
Smallest0.3 GB
GGUF
LA
Laguna-XS-2.1
Laguna · ggml-org
Params33.4B
Context256K
Q4_K_M19.6 GB
GGUF
MI
Devstral Small 2 24B Instruct 2512
Mistral · ggml-org
Params23.6B
Context384K
Smallest25.1 GB
CodingVision
BG
Bge Small En v1.5
BGE · ggml-org
Params33M
Context512
Smallest0.0 GB
Embedding
MI
Pixtral
Mistral · ggml-org
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
IN
InternVL3 1B Instruct
Internvl · ggml-org
Params630M
Context32K
Smallest0.7 GB
Vision
GE
Gemma 3 27b It
Gemma · ggml-org
Params27B
Context128K
Q4_K_M16.5 GB
Vision
QW
Qwen3 Coder 30B A3B Instruct
Qwen · ggml-org
Params30.5B
Context256K
Smallest32.5 GB
Coding
LF
LFM2.5-24B-A2B
Lfm · ggml-org
Params24B
Context128K
Q4_K_M14.5 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
GGUF
QW
Qwen2.5 VL 32B Instruct
Qwen · ggml-org
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
Qwen2.5 VL 72B Instruct
Qwen · ggml-org
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
ED
vllm-d3-edge
Edge · ggml-org
Params748M
Context256K
Smallest0.8 GB
Vision
EM
Embeddinggemma 300M Qat Q4_0 Unquantized
Embeddinggemma · ggml-org
Params303M
Context2K
Smallest0.3 GB
Embedding
IN
InternVL3 8B Instruct
Internvl · ggml-org
Params7.61B
Context32K
Q4_K_M4.7 GB
Vision
GE
Gemma 3 27b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params27B
Context128K
Smallest15.9 GB
Vision
LL
ultravox v0 5 llama 3 1 8b
Llama · ggml-org
Params8B
Context128K
Q4_K_M4.9 GB
Vision
MI
MiMo-V2.6-Pro-MOPD
Mimo · ggml-org
Params1020B
Context1024K
Smallest2.1 GB
Vision
GE
Gemma 3 12b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params11.8B
Context128K
Smallest7.1 GB
Vision
SM
SmolVLM Instruct
Smolvlm · ggml-org
Params1.81B
Context16K
Q4_K_M1.1 GB
Vision
MU
Muse Spark Open 816B A42B
Muse · ggml-org
Params816B
Context—
Smallest0.8 GB
GGUF
NE
NVIDIA-Nemotron-3.5-Bolt-E4B-DFlash
Nemotron · ggml-org
Params7.52B
Context128K
Smallest0.6 GB
ReasoningTool use
GE
Gemma 3 1b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params1B
Context32K
Smallest0.7 GB
GGUF
QW
Qwen3-8B
Qwen · ggml-org
Params8.19B
Context40K
Smallest1.1 GB
GGUF

Keep browsing