GGUF models that fit in 4 GB

79024 GGUF language models have at least one quant whose estimated memory use is 4 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 1280000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Sakura MiniCPM V 4.7 1B Uncensored
MiniCPM · webmp3
Params1.01B
Context256K
Best fitQ8_0 2.0 GB
Vision
MU
Muse Glimmer 30B AZ Focus
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
ReasoningTool use
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Best fitQ2_K 4.0 GB
Coding
QW
Qwen3 14B NSFW FDA
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3 1.7B
Qwen · rippertnt
Params2.03B
Context40K
Best fitQ4_K_M 2.7 GB
GGUF
GP
SpaceQA Gpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
QW
Qwen3.5-4B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · Andycurrent
Params4.21B
Context256K
Best fitQ3_K_M 3.8 GB
Vision
LF
LFM2 24B A2B
Lfm · bartowski
Params23.8B
Context125K
Q4_K_M14.4 GB
GGUF
QW
Qwen3 0.6B
Qwen · NobodyWho
Params752M
Context32K
Best fitQ4_K_M 1.9 GB
GGUF
QW
Suri Qwen 3.8 27B Neuro
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3 VL 4B Instruct Uncensored
Qwen · mradermacher
Params4B
Context256K
Best fitIQ4_XS 4.0 GB
Vision
QW
FlashModel Qwen 3.6 35B A3B Maxed
Qwen · flashback2k
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
OP
OpenELM-3B-Instruct
Openelm · SanctumAI
Params3.04B
Context2K
Best fitQ6_K 3.3 GB
GGUF
SP
SpydazWeb_AI_LCARS_Humanization_003
Spydazweb · mradermacher
Params7.24B
Context512K
Best fitIQ2_S 3.9 GB
Coding
MO
MOSS TTS Realtime
Moss · BricksDisplay
Params2.08B
Context40K
Best fitQ8_0 3.9 GB
GGUF
CO
CogEvol 4B
Cogevol · bartowski
Params4.21B
Context256K
Best fitQ3_K_M 4.0 GB
Vision
QW
Qwen2.5 7b Alpaca
Qwen · mradermacher
Params7.62B
Context32K
Best fitQ2_K 4.0 GB
GGUF
QW
ThinCtx Qwen3.5 0.8B
Qwen · mradermacher
Params752M
Context256K
Best fitQ5_K_S 1.5 GB
GGUF
GE
gemma 2 it
Gemma · unsloth
Params2.61B
Context8K
Best fitQ6_K 3.5 GB
GGUF
SE
Seed-Coder-8B-Instruct
Seed · unsloth
Params8.25B
Context32K
Best fitIQ1_M 4.0 GB
Coding
TO
TooManyMixRolePlay-7B-Story_V2
Toomanymixroleplay · mradermacher
Params7.24B
Context32K
Best fitIQ2_S 3.9 GB
Roleplay
QW
Qwen2.5 1.5B Instruct
Qwen · ThomasBaruzier
Params1.54B
Context32K
Best fitF16 3.8 GB
GGUF
GL
GLM 4.5 Air
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
GGUF
LF
LFM2.5 2.6B
Lfm · bartowski
Params2.7B
Context125K
Best fitQ3_K_L 4.0 GB
GGUF
AY
Aya Expanse 8b
Aya · duyntnet
Params8B
Context8K
Best fitIQ1_M 3.9 GB
GGUF
GE
Darkidol Gemma 4 E4B It
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
Roleplay
GL
Glm Edge 4b Chat
GLM · zai-org
Params4.33B
Context3K
Best fitQ4_0 4.0 GB
GGUF
TE
TerminalHorizon 27B
Terminalhorizon · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
Vision
HO
K2-Horizon-7B
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
GGUF
ST
Starcoder2 3b
StarCoder · mradermacher
Params3.03B
Context16K
Best fitQ6_K 3.2 GB
Coding

Other memory sizes

Keep browsing