GGUF models by vultr

35 GGUF models quantized by vultr on Hugging Face. Sizes run from 3.66B to 743B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiMo-V2.6-Flash-RL
Mimo · vultr
Params309B
Context1024K
Smallest2.4 GB
ReasoningTool useVision
NE
NVIDIA-Nemotron-3-Nano-30B-A3B
Nemotron · vultr
Params31.6B
Context1024K
Q4_K_M27.0 GB
ReasoningTool use
NE
Nex-N2.5-mini
Nex · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
ReasoningTool useVision
GL
GLM-5.3-Flash
GLM · vultr
Params313B
Context1024K
Q4_K_M208.2 GB
ReasoningTool useVision
QW
Qwen3.8-Flash-Next
Qwen · vultr
Params177B
Context256K
Q4_K_M131.0 GB
ReasoningTool useVision
MU
Muse-Glimmer-30B
Muse · vultr
Params27.9B
Context128K
Q4_K_M18.6 GB
ReasoningTool useVision
QW
Qwen3.6-35B-A3B
Qwen · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
ReasoningTool useVision
QW
Qwen3.6-27B
Qwen · vultr
Params26.9B
Context256K
Q4_K_M18.0 GB
ReasoningTool useVision
OR
Ornith-1.5-35B-A3B
Ornith · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
ReasoningTool useVision
QW
Qwen3.8-27B
Qwen · vultr
Params26.9B
Context256K
Q4_K_M18.0 GB
ReasoningTool useVision
DE
DeepSeek V4 Flash 0731
DeepSeek · vultr
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · vultr
Params284B
Context1024K
Smallest5.7 GB
GGUF
QW
Qwen-AgentWorld-35B-A3B
Qwen · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
ReasoningTool use
OR
Ornith-1.5-397B
Ornith · vultr
Params396B
Context256K
Q4_K_M264.4 GB
ReasoningTool useVision
MI
MiniMax-M3
Minimax · vultr
Params426B
Context1024K
Q4_K_M283.6 GB
ReasoningTool useVision
OR
Ornith-1.5-9B
Ornith · vultr
Params8.95B
Context256K
Q4_K_M6.1 GB
ReasoningTool useVision
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · vultr
Params284B
Context1024K
Smallest10.9 GB
GGUF
LA
Laguna-S-2.1
Laguna · vultr
Params118B
Context1024K
Q4_K_M78.3 GB
ReasoningTool use
HY
Hy3
vultr
Params295B
Context256K
Q4_K_M196.3 GB
ReasoningTool use
QW
Qwen3.5-122B-A10B
Qwen · vultr
Params122B
Context256K
Q4_K_M81.6 GB
ReasoningTool useVision
LI
Ling-3.0-flash
Ling · vultr
Params124B
Context256K
Q4_K_M82.8 GB
ReasoningTool use
ST
Step-3.7-Flash
Step · vultr
Params197B
Context256K
Q4_K_M130.4 GB
ReasoningTool useVision
QW
Qwen3.5-397B-A17B
Qwen · vultr
Params396B
Context256K
Q4_K_M264.4 GB
ReasoningTool useVision
GR
granite-4.2-30b
Granite · vultr
Params29.3B
Context128K
Q4_K_M19.2 GB
ReasoningTool use
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Nemotron · vultr
Params31.6B
Context1024K
Q4_K_M27.0 GB
ReasoningTool use
NE
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
Nemotron · vultr
Params121B
Context1024K
Q4_K_M94.6 GB
ReasoningTool useVision
QW
Qwen3.5-9B
Qwen · vultr
Params8.95B
Context256K
Q4_K_M6.1 GB
ReasoningTool useVision
QW
Qwen3.5-0.8B
Qwen · vultr
Params752M
Context256K
Q4_K_M0.6 GB
ReasoningTool useVision
NE
NVIDIA-Nemotron-3.5-Bolt-74B-A9B
Nemotron · vultr
Params74B
Context1024K
Q4_K_M51.0 GB
ReasoningTool useVision
GR
granite-4.2-3b
Granite · vultr
Params3.66B
Context128K
Q4_K_M2.5 GB
ReasoningTool use

About vultr on Hugging Face

vultr has published 35 GGUF models that ggufmodels.com tracks, across families such as Nemotron, Qwen and Ling. The most downloaded are MiMo-V2.6-Flash-RL, NVIDIA-Nemotron-3-Nano-30B-A3B and Nex-N2.5-mini.

The quants vultr publishes most often are IQ3_S (35), IQ3_M (35), Q5_K_M (31) and Q4_K_M (31). Their Q4_K_M files range from 2.5 to 492.8 GB. Parameter counts run from 3.66B to 743B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has vultr published?

35 models are listed here, mainly from the Nemotron, Qwen and Ling families. The most downloaded is MiMo-V2.6-Flash-RL.

Which quants does vultr publish?

The most common are IQ3_S (35 models), IQ3_M (35 models), Q5_K_M (31 models) and Q4_K_M (31 models).

Keep browsing