GGUF models that fit in 48 GB
201364 GGUF language models have at least one quant whose estimated memory use is 48 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.
What runs in 48 GB of VRAM?
A GGUF model fits when its file plus the KV cache for an 8K context window plus about 0.5 GB of runtime stays under 48 GB. 201,364 language models have at least one quant that does. Each card shows the largest quant of that model that still fits, because the largest one that fits is the closest to the original quality.
The most downloaded models that fit are Qwen3.8-27B, Ornith-1.5-9B and Ornith-1.5-35B. At this size, larger models fit at 4-bit, and smaller models can use higher-quality quants and long context windows. If you are close to the limit, a smaller context or a smaller quant frees memory.
Frequently asked questions
What is the best GGUF model for 48 GB of VRAM?
By downloads, Qwen3.8-27B is the most popular model that fits. “Best” depends on what you do, so compare the sizes and quants on this page and check the model pages for the details.
How is "fits in 48 GB" decided?
We add the GGUF file size, an fp16 KV cache for an 8K context (worked out from each model’s header) and 0.5 GB for the runtime. The result is an estimate, not a measurement.