GGUF models that fit in 6 GB

123636 GGUF language models have at least one quant whose estimated memory use is 6 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
Glm Edge 4b Chat
GLM · zai-org
Params4.33B
Context3K
Best fitQ6_K 5.1 GB
GGUF
TE
TerminalHorizon 27B
Terminalhorizon · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
Vision
SY
maywell_synatra-7b-v0.3-rp
Synatra · TheBloke
Params7.24B
Context32K
Best fitQ4_K_M 5.9 GB
Roleplay
HO
K2-Horizon-7B
Horizon · mradermacher
Params9B
Context512K
Best fitQ3_K_S 6.0 GB
GGUF
ST
Starcoder2 3b
StarCoder · mradermacher
Params3.03B
Context16K
Best fitQ6_K 3.2 GB
Coding
MA
MAI Gym 9B
Mai · mradermacher
Params8.95B
Context256K
Best fitIQ3_S 6.0 GB
GGUF
GR
Groot 19B A3B 261023
Groot · mradermacher
Params19B
Context256K
Q4_K_M11.7 GB
ReasoningTool use
QW
Ostrich 27B 261008 Qwen3.8 Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
CA
CalibForge 35B A3B
Calibforge · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
ThinCtx Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Best fitQ6_K 2.5 GB
GGUF
QW
Qwen3.5 DeltaCoder 9B
Qwen · danielcherubini
Params8.95B
Context256K
Best fitQ3_K_S 5.8 GB
CodingReasoningTool use
AC
ActIO-UI-7B-RLVR
Actio · mradermacher
Params7.62B
Context125K
Best fitQ4_1 5.8 GB
GGUF
LL
Ornith 1.0 35B
Llama · LordNeel
Params34.7B
Context256K
Best fitBF16 4.9 GB
GGUF
D1
d1 3B
AtomicChat
Params2.7B
Context32K
Best fitQ8_0 5.4 GB
ReasoningTool useVision
LB
LBS 27B
Lbs · bartowski
Params26.9B
Context256K
Q4_K_M17.2 GB
ReasoningTool useVision
PE
Peach 9B 8k Roleplay
Peach · bartowski
Params8.83B
Context16K
Best fitQ3_K_L 6.0 GB
Roleplay
LL
chargoddard llama 2 26b trenchcoat stack
Llama · RichardErkhov
Params25.7B
Context—
Best fitIQ4_XS 3.4 GB
GGUF
HO
K2 Horizon 7B UnrealEngine
Horizon · mradermacher
Params9B
Context512K
Best fitQ3_K_S 6.0 GB
CodingReasoningTool use
GE
Gemma 4 E4B It Uncensored Heretic
Gemma · OS-Software
Params7.46B
Context128K
Best fitQ2_K_XL 5.6 GB
Vision
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
QW
Qwen3.8 4b Heretic Trial23
Qwen · hakergeniusz
Params4.21B
Context256K
Best fitQ4_K_M 4.3 GB
GGUF
PR
Bu 30b A3B Preview
Preview · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
EX
EXAONE 3.5 7.8B Instruct
Exaone · lmstudio-community
Params7.8B
Context32K
Best fitQ3_K_L 5.8 GB
GGUF
VE
VeriLoop E2
Veriloop · tsinghua-sigs-robot-lab
Params27B
Context256K
Best fitQ8_0 5.9 GB
Reasoning
ME
Meltemi 7B Instruct v1.5
Meltemi · mradermacher
Params7.48B
Context32K
Best fitQ4_0 5.9 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct
Exaone · bartowski
Params7.8B
Context32K
Best fitIQ4_XS 5.9 GB
GGUF
QW
Qwen3.8-Flash-CIRU-STRIX-IU4-MTP
Qwen · jcbtc
Params126B
Context256K
Best fitQ8_0 5.5 GB
Vision
GR
Granite 8b Code Instruct
Granite · duyntnet
Params8.05B
Context4K
Best fitQ3_K_L 6.0 GB
Coding
GE
Gemma 4 E2B Conversational Uncensored
Gemma · minas2025
Params4.65B
Context128K
Smallest5.0 GB
Vision
LL
llava llama 3 8b v1 1 imat
Llama · city96
Params8B
Context8K
Best fitIQ4_XS 6.0 GB
Vision

Other memory sizes

Keep browsing