GGUF models that fit in 8 GB

151917 GGUF language models have at least one quant whose estimated memory use is 8 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MO
Mox Small 1
Mox · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
MI
MiniMax M2.1
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
HU
Huihui Agents A1 Abliterated
Huihui · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
OX
OxCoder 9B
Oxcoder · mradermacher
Params8.95B
Context256K
Best fitQ5_K_M 8.0 GB
CodingVision
OP
OpenCoder 1.5B Instruct
Opencoder · lmstudio-community
Params1.91B
Context4K
Best fitQ8_0 4.3 GB
Coding
QW
Qwen3.8 9B Heretic Uncensored
Qwen · optionalAI
Params8.95B
Context256K
Best fitQ4_K_M 7.2 GB
ReasoningTool use
HO
Holo 3.1 9B
Holo · prithivMLmods
Params8.95B
Context256K
Best fitQ5_K_M 8.0 GB
Vision
MI
Devstral 2 123B Instruct 2512
Mistral · bartowski
Params125B
Context256K
Q4_K_M74.9 GB
Coding
QW
Remnant Qwen3 8b
Qwen · bartowski
Params8.19B
Context32K
Best fitQ5_K_L 7.9 GB
Roleplay
HE
L3.1 RP Hero Dirty Harry 8B
Hero · DavidAU
Params8B
Context128K
Best fitQ5_K_M 7.3 GB
Roleplay
VI
Vietnamese 4B Chat Abliterated
Vietnamese · mradermacher
Params4.21B
Context256K
Best fitQ6_K 5.1 GB
GGUF
CA
calme-2.3-legalkit-8b
Calme · mradermacher
Params8B
Context128K
Best fitQ5_K_M 7.3 GB
GGUF
QW
Liberation Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Best fitQ5_K_M 7.6 GB
ReasoningTool use
QW
CaptchaKraken v1.2
Qwen · CaptchaKraken
Params8.95B
Context256K
Best fitQ4_K_M 7.2 GB
Vision
HY
HY MT1.5 1.8B
mradermacher
Params1.79B
Context256K
Best fitF16 4.6 GB
GGUF
PR
Prashna 7b
Prashna · mradermacher
Params7.62B
Context32K
Best fitQ6_K 7.2 GB
ReasoningTool use
MA
Mario Html v2 9B
Mario · bartowski
Params9.2B
Context256K
Best fitQ4_K_L 7.9 GB
ReasoningTool useVision
TE
q-bert_terminis-7b
Terminis · TheBloke
Params7.24B
Context32K
Best fitQ6_K 7.5 GB
GGUF
DE
Deepseek Coder 6.7b Base
DeepSeek · mradermacher
Params6.74B
Context16K
Best fitIQ3_M 7.9 GB
Coding
KA
KAT Ornith HERO 35B A3B Fusion
Kat · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
DA
DataPilot ArrowPro 7B RobinHood
Datapilot · mmnga
Params7.24B
Context4K
Best fitQ6_K 7.5 GB
GGUF
HO
Honey Yuzu 13B
Honey · mradermacher
Params12.5B
Context8K
Best fitIQ3_M 8.0 GB
Roleplay
MO
Mox Tiny 1
Mox · mradermacher
Params8B
Context128K
Best fitQ5_K_M 7.3 GB
ReasoningRoleplay
QW
Qwen3.5 0.8B Finetuned Lora Uncensored
Qwen · mradermacher
Params752M
Context256K
Best fitQ5_K_S 1.5 GB
Vision
QW
Qwen2.5 0.5B Instruct heretic
Qwen · saidutta69
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
MI
monology_openinstruct-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Best fitQ6_K 7.5 GB
GGUF
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · mradermacher
Params8.19B
Context256K
Best fitQ5_K_M 7.6 GB
Vision
QW
Qwen3 VL 4B Instruct Abliterated
Qwen · mradermacher
Params4B
Context256K
Best fitQ8_0 6.0 GB
Vision
QW
flux2 klein 4B uncensored text encoder
Qwen · Cordux
Params4B
Context—
Best fitQ4_0 3.2 GB
Coding
QW
Qwen3.5 4B Instruct
Qwen · openresearchtools
Params4.21B
Context256K
Best fitQ8_0 6.1 GB
Vision

Other memory sizes

Keep browsing