GGUF models that fit in 8 GB
151917 GGUF language models have at least one quant whose estimated memory use is 8 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.
What runs in 8 GB of VRAM?
A GGUF model fits when its file plus the KV cache for an 8K context window plus about 0.5 GB of runtime stays under 8 GB. 151,917 language models have at least one quant that does. Each card shows the largest quant of that model that still fits, because the largest one that fits is the closest to the original quality.
The most downloaded models that fit are Qwen3.8-27B, Ornith-1.5-9B and Qwen3.8 27B Uncensored. At this size, 7B and 8B models fit at 4-bit, and smaller models leave more room for context. If you are close to the limit, a smaller context or a smaller quant frees memory.
Frequently asked questions
What is the best GGUF model for 8 GB of VRAM?
By downloads, Qwen3.8-27B is the most popular model that fits. “Best” depends on what you do, so compare the sizes and quants on this page and check the model pages for the details.
How is "fits in 8 GB" decided?
We add the GGUF file size, an fp16 KV cache for an 8K context (worked out from each model’s header) and 0.5 GB for the runtime. The result is an estimate, not a measurement.