GGUF models that fit in 8 GB
151917 GGUF language models have at least one quant whose estimated memory use is 8 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.
LF
LFM2.5-350M
Lfm · LiquidAI
Params354M
Context125K
Best fitBF16 1.7 GB
FL
FLUX.2 klein 4B
Flux · leejet
Params3.88B
Context—
Best fitQ8_0 5.3 GB
QW
Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Best fitQ8_0 5.4 GB
MI
MiniCPM o 4 5
MiniCPM · openbmb
Params8.2B
Context40K
Best fitQ5_1 7.9 GB
CP
CPH Community 7B
Cph · CypherTroopers
Params7B
Context—
Best fitQ4_K_M 0.5 GB
QW
Qwen3.8 35B A3B Distill
Qwen · IsValorum
Params34.7B
Context256K
Best fitQ8_0 3.2 GB
GE
Gemma 4 E4B It Ultra Uncensored Heretic
Gemma · llmfan46
Params7.5B
Context128K
Best fitQ5_K_M 7.7 GB
GE
Gemma 3 1b It
Gemma · lmstudio-community
Params1B
Context32K
Best fitQ8_0 1.8 GB
BO
Bonsai-1.7B
Bonsai · prism-ml
Params1.72B
Context32K
Best fitQ1_0 1.7 GB
PA
PaddleOCR VL 1.6
Paddleocr · PaddlePaddle
Params467M
Context128K
Smallest0.9 GB
QW
Qwen3 4B Instruct 2507
Qwen · lmstudio-community
Params4B
Context256K
Best fitQ8_0 6.0 GB
QW
Qwen3-Vl-2B-Instruct
Qwen · unsloth
Params1.72B
Context256K
Best fitBF16 4.9 GB
QW
Qwen2.5 Coder 3B Instruct AWQ
Qwen · Qwen
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
Qwen3.8 27B Humanlike Chat
Qwen · LessThanThreeAI
Params26.9B
Context256K
Best fitF16 7.3 GB
GE
Gemma-3-270M-It
Gemma · unsloth
Params268M
Context32K
Best fitF16 1.2 GB
GE
Gemma-4-E2B-Uncensored-HauhauCS-Aggressive
Gemma · HauhauCS
Params4.65B
Context128K
Best fitQ8_K 6.1 GB
QW
Qwen2.5 Omni 3B
Qwen · ggml-org
Params3.4B
Context32K
Best fitF16 7.6 GB
QW
Qwen3.6-27B
Qwen · ggml-org
Params26.9B
Context256K
Best fitBF16 6.1 GB
QW
Huihui Qwen3 Coder 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Best fitIQ1_S 7.7 GB
HE
Hermes 4 14B
Hermes · bartowski
Params14.8B
Context40K
Best fitIQ3_XXS 7.8 GB
MI
Devstral-Small-2-24B-Instruct-2512
Mistral · unsloth
Params23.6B
Context384K
Best fitIQ1_M 7.9 GB
QW
Qwen3.5-9B
Qwen · unsloth
Params9.2B
Context256K
Best fitQ4_K_XL 7.7 GB
NE
Nemotron 3 Embed 1B Q4 K M
Nemotron · zenmagnets
Params1.14B
Context256K
Best fitQ4_K_M 1.8 GB
GE
Gemma 3 4b It
Gemma · ggml-org
Params3.88B
Context128K
Best fitQ8_0 5.8 GB
NA
Nanbeige4.3 33B
Nanbeige · bartowski
Params33.1B
Context512K
Q4_K_M20.8 GB
QW
Qwen3.5 9B Abliterated
Qwen · lukey03
Params8.95B
Context256K
Best fitQ4_K_M 7.2 GB
MO
MOSS-Music-8B
Moss · nerualdreming
Params8.19B
Context40K
Best fitQ4_K_M 6.9 GB
GE
gemma 4 31B it qat
Gemma · unsloth
Params480M
Context128K
Best fitBF16 3.6 GB
GR
Granite 4.0 1B BE
Granite · taronaeo
Params1.63B
Context—
Best fitF32 7.8 GB
GE
gemma-4-12B-it
Gemma · ggml-org
Params11.9B
Context256K
Best fitBF16 2.4 GB