GGUF models by dispatchAI
36 GGUF models quantized by dispatchAI on Hugging Face. Sizes run from 135M to 7.62B parameters. The longest trained context is 1024K tokens.
QW
Qwen3 Embedding 0.6b
Qwen · dispatchAI
Params596M
Context32K
Smallest0.6 GB
SM
SmolLM2 1.7B Instruct mobile
SmolLM · dispatchAI
Params1.71B
Context8K
Smallest1.1 GB
MI
MiniCPM5 1B
MiniCPM · dispatchAI
Params1.08B
Context128K
Smallest0.7 GB
PH
Phi 3.5 Mini Instruct
Phi · dispatchAI
Params3.82B
Context128K
Smallest2.8 GB
TI
TinyLlama 1.1B Chat mobile int4
Tinyllama · dispatchAI
Params1.1B
Context2K
Smallest0.7 GB
SM
SmolLM2 1.7B Instruct Q5 mobile
SmolLM · dispatchAI
Params1.71B
Context8K
Smallest1.2 GB