GGUF models that fit in 16 GB
182247 GGUF language models have at least one quant whose estimated memory use is 16 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.
What runs in 16 GB of VRAM?
A GGUF model fits when its file plus the KV cache for an 8K context window plus about 0.5 GB of runtime stays under 16 GB. 182,247 language models have at least one quant that does. Each card shows the largest quant of that model that still fits, because the largest one that fits is the closest to the original quality.
The most downloaded models that fit are Qwen3.8-27B, Ornith-1.5-9B and Qwen3.8-27B. At this size, models up to roughly 14B fit at 4-bit, and 7B and 8B models can use 6-bit or 8-bit quants. If you are close to the limit, a smaller context or a smaller quant frees memory.
Frequently asked questions
What is the best GGUF model for 16 GB of VRAM?
By downloads, Qwen3.8-27B is the most popular model that fits. “Best” depends on what you do, so compare the sizes and quants on this page and check the model pages for the details.
How is "fits in 16 GB" decided?
We add the GGUF file size, an fp16 KV cache for an 8K context (worked out from each model’s header) and 0.5 GB for the runtime. The result is an estimate, not a measurement.