GGUF models by ggml-org
224 GGUF models quantized by ggml-org on Hugging Face. Sizes run from 1M to 1050B parameters. The longest trained context is 10240K tokens.
VO
Voxtral Mini 3B 2507
Voxtral · ggml-org
Params4B
Context128K
Q4_K_M2.5 GB
QW
Qwen3 0.6B
Qwen · ggml-org
Params752M
Context40K
Smallest0.4 GB
GL
GLM OCR
GLM · ggml-org
Params891M
Context128K
Smallest1.0 GB
QW
Qwen3 TTS 12Hz 1.7B Base
Qwen · ggml-org
Params1.73B
Context32K
Q4_K_M1.0 GB
OP
Tinyopenjev For Testing
Openjev · ggml-org
Params33M
Context256K
Smallest0.0 GB
QW
Qwen3 ASR 1.7B
Qwen · ggml-org
Params2.03B
Context64K
Smallest2.2 GB
TE
test model stories260K
Test · ggml-org
Params—
Context—
Smallest0.0 GB
SM
SmolVLM2 2.2B Instruct
Smolvlm · ggml-org
Params1.81B
Context8K
Q4_K_M1.1 GB
GE
gemma-4-31B-it
Gemma · ggml-org
Params30.7B
Context256K
Smallest0.3 GB
SM
SmolVLM 500M Instruct
Smolvlm · ggml-org
Params409M
Context8K
Smallest0.4 GB
QW
Qwen3 Omni 30B A3B Thinking
Qwen · ggml-org
Params30.5B
Context64K
Q4_K_M18.6 GB
TE
test model stories260K infill
Test · ggml-org
Params—
Context—
Smallest0.0 GB
EM
Embeddinggemma 300m Qat Q8_0 Unquantized
Embeddinggemma · ggml-org
Params303M
Context2K
Smallest0.3 GB
LL
tiny llamas
Llama · ggml-org
Params24M
Context—
Smallest0.0 GB
CL
Clef
Clef · ggml-org
Params27B
Context256K
Q4_K_M19.5 GB
SM
SmolLM3 3B
SmolLM · ggml-org
Params3.08B
Context64K
Q4_K_M1.9 GB
GL
GLM 4.7 Flash
GLM · ggml-org
Params30B
Context198K
Smallest18.2 GB
VL
vllm-d3
ggml-org
Params26.9B
Context256K
Q4_K_M19.4 GB
LA
Laya
Laya · ggml-org
Params421M
Context8K
Smallest0.4 GB
QW
Qwen3 VL 2B Instruct
Qwen · ggml-org
Params1.72B
Context256K
Smallest1.8 GB
BG
bge m3 Q8 0
BGE · ggml-org
Params567M
Context8K
Smallest0.6 GB
BE
Bespoke-Nimble-9B-v3
Bespoke · ggml-org
Params8.95B
Context256K
Q4_K_M6.3 GB
TI
Tinylaya For Testing
Tinylaya · ggml-org
Params90M
Context8K
Smallest0.1 GB
SM
SmolVLM2 500M Video Instruct
Smolvlm · ggml-org
Params409M
Context8K
Smallest0.4 GB
SM
SmolVLM 256M Instruct
Smolvlm · ggml-org
Params163M
Context8K
Smallest0.2 GB
FL
vllm-d3-flash
Flash · ggml-org
Params8.95B
Context256K
Q4_K_M6.6 GB
QW
Qwen3 ASR 0.6B
Qwen · ggml-org
Params752M
Context64K
Smallest0.8 GB
GL
GLM 4.6V Flash
GLM · ggml-org
Params9.4B
Context128K
Q4_K_M6.2 GB
GL
GLM 4.6V
GLM · ggml-org
Params107B
Context128K
Q4_K_M70.4 GB
MI
vllm-d3-mini
Mini · ggml-org
Params4.84B
Context256K
Q4_K_M3.7 GB