GGUF models that fit in 8 GB
151917 GGUF language models have at least one quant whose estimated memory use is 8 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · HauhauCS
Params8.95B
Context256K
Best fitQ4_K_M 7.2 GB
QW
qwen2.5-7b-instruct
Qwen · Qwen
Params7.6B
Context128K
Best fitQ6_K 7.2 GB
QW
Qwen3 4B Instruct Awq
Qwen · Qwen
Params4B
Context40K
Best fitQ8_0 6.0 GB
GE
gemma 4 E2B it qat mobile
Gemma · unsloth
Params92M
Context128K
Best fitQ2_K_XL 2.8 GB
QW
Qwen Image 2.1 Turbo Uncensored
Qwen · AtomicChat
Params8.19B
Context256K
Best fitQ5_K 8.0 GB
QW
Qwen3.8 4B
Qwen · empero-ai
Params4.33B
Context256K
Best fitQ8_0 6.2 GB
QW
Qwen3Vl 4b Instruct
Qwen · Qwen
Params4B
Context256K
Best fitQ8_0 6.0 GB
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO MTP DFlash2
Qwen · nerkyor
Params27.3B
Context256K
Best fitQ8_0 5.8 GB
JI
jinen-v1-small-hf
Jinen · togatogah
Params110M
Context1K
Best fitF16 1.2 GB
SU
surya ocr 2
Surya · datalab-to
Params632M
Context256K
Smallest1.3 GB
QW
Qwen_Qwen3.5 9B
Qwen · lmstudio-community
Params8.95B
Context256K
Best fitQ4_K_M 7.2 GB
YU
YuE2 LM
Yue · scragnog
Params3.8B
Context24K
Best fitQ8_0 5.4 GB
GL
GLM 5.3 Flash Maya
GLM · peasantsmith
Params370B
Context64K
Smallest0.0 GB
NO
nomic-embed-text-v1.5
Nomic · nomic-ai
Params137M
Context2K
Best fitF32 1.3 GB
QW
Qwen3.8-27B-Uncensored-Cyber
Qwen · philbert440
Params27B
Context256K
Best fitQ8_0 5.8 GB
GE
Gemma-4-E4B-It
Gemma · unsloth
Params7.5B
Context128K
Best fitQ5_K_M 7.4 GB
QW
Qwen3.8 9B
Qwen · empero-ai
Params9.2B
Context256K
Best fitQ4_K_M 7.4 GB
LF
LFM2.5 2.6B
Lfm · LiquidAI
Params2.7B
Context128K
Best fitBF16 7.9 GB
QW
Qwen3.8 Flash Next Gyro
Qwen · agentionai
Params177B
Context256K
Smallest2.7 GB
QW
Qwen3-4B
Qwen · unsloth
Params4B
Context40K
Best fitQ8_K_XL 6.8 GB
QW
Qwen3.8 Flash Next
Qwen · AtomicChat
Params177B
Context256K
Q4_K_M94.5 GB
UM
Umt5 Xxl
Umt · city96
Params5.68B
Context512
Best fitQ5_K_M 7.9 GB
AD
AdaVaR 3B
Adavar · mradermacher
Params3.09B
Context125K
Best fitF16 7.0 GB
QW
Qwen3.8 2B
Qwen · empero-ai
Params1.94B
Context256K
Best fitBF16 4.8 GB
GE
Gemma-4-E2B-It
Gemma · unsloth
Params4.65B
Context128K
Best fitQ8_K_XL 6.4 GB
QW
Ternary Bonsai 27B
Qwen · prism-ml
Params3.6B
Context4K
Best fitBF16 7.9 GB
GE
Gemma 4 E4B
Gemma · lmstudio-community
Params7.5B
Context128K
Best fitQ4_K_M 7.2 GB
QW
Qwen3-4B-Instruct-2507
Qwen · unsloth
Params4B
Context256K
Best fitQ8_K_XL 6.8 GB
MO
models moved
Models · ggml-org
Params34M
Context—
Best fitF16 6.7 GB
LA
Laguna S 2.1
Laguna · poolside
Params118B
Context1024K
Best fitBF16 4.3 GB