GGUF models by dispatchAI

36 GGUF models quantized by dispatchAI on Hugging Face. Sizes run from 135M to 7.62B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Embedding 0.6b
Qwen · dispatchAI
Params596M
Context32K
Smallest0.6 GB
EmbeddingReasoningTool use
SM
SmolLM2 1.7B Instruct mobile
SmolLM · dispatchAI
Params1.71B
Context8K
Smallest1.1 GB
GGUF
MI
MiniCPM5 1B
MiniCPM · dispatchAI
Params1.08B
Context128K
Smallest0.7 GB
ReasoningTool use
PH
Phi 3.5 Mini Instruct
Phi · dispatchAI
Params3.82B
Context128K
Smallest2.8 GB
GGUF
TI
TinyLlama 1.1B Chat mobile int4
Tinyllama · dispatchAI
Params1.1B
Context2K
Smallest0.7 GB
GGUF
SM
SmolLM2 1.7B Instruct Q5 mobile
SmolLM · dispatchAI
Params1.71B
Context8K
Smallest1.2 GB
GGUF

Keep browsing