GGUF models that fit in 6 GB

123636 GGUF language models have at least one quant whose estimated memory use is 6 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
Glm Oss 8b
GLM · mradermacher
Params8B
Context128K
Best fitIQ4_XS 6.0 GB
GGUF
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · mradermacher
Params8.19B
Context40K
Best fitQ3_K_M 5.8 GB
GGUF
RU
RusMind Malysh 4.7
Rusmind · mradermacher
Params752M
Context256K
Best fitQ4_1 1.5 GB
ReasoningTool use
QW
Qwen3.5 9b Triple Loop Fase2
Qwen · mradermacher
Params8.95B
Context256K
Best fitIQ3_M 6.0 GB
ReasoningTool use
AS
Aspire 8B model stock i1
Aspire · mradermacher
Params8B
Context8K
Best fitIQ4_XS 6.0 GB
GGUF
GR
Granite 3.1 3b A800M Instruct
Granite · bartowski
Params3.3B
Context128K
Best fitQ8_0 4.5 GB
GGUF
QW
Heretic Qwen3.5 4b
Qwen · mradermacher
Params4.21B
Context256K
Best fitQ6_K 5.1 GB
ReasoningTool use
MI
danielbrdz_barcenas-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Best fitQ4_K_M 5.9 GB
GGUF
MI
rana shahroz mistral 7b openorca20k
Mistral · RichardErkhov
Params7.24B
Context32K
Best fitQ4_K 5.9 GB
GGUF
IM
z image solordz v2
Image · gimly13
Params6.15B
Context40K
Best fitQ8_0 6.0 GB
GGUF
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Best fitQ4_1 5.8 GB
GGUF
QW
Qwen2.5 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context32K
Best fitQ6_K 3.6 GB
GGUF
GR
Granite 8b Code Base 4k
Granite · RichardErkhov
Params8.05B
Context4K
Best fitQ3_K_L 6.0 GB
Coding
ZE
zed industries zeta 2
Zeta · bartowski
Params8.25B
Context32K
Best fitQ3_K_M 5.8 GB
GGUF
QW
Qwen3 4B Base
Qwen · mradermacher
Params4B
Context32K
Best fitQ8_0 6.0 GB
GGUF
OL
open r1 OlympicCoder 7B
Olympiccoder · bartowski
Params7.62B
Context32K
Best fitQ4_1 5.8 GB
CodingReasoning
VI
Vinci MLE 8B 1.0
Vinci · mradermacher
Params8.79B
Context128K
Best fitIQ3_M 5.9 GB
Tool use
CU
CursorCore QW2.5 1.5B i1
Cursorcore · mradermacher
Params1.54B
Context32K
Best fitQ6_K 2.0 GB
Coding
QW
Qwen_Qwen3 VL 2B Instruct
Qwen · lmstudio-community
Params1.72B
Context256K
Best fitQ8_0 3.3 GB
Vision
GL
Huihui GLM 4.6V Flash Abliterated
GLM · mradermacher
Params9.4B
Context128K
Best fitQ3_K_L 6.0 GB
GGUF
QW
MARTHA LXVII.8B QWEN 3.5 3.6 prune 9b 3.6 base
Qwen · ZERO-POINT-AI
Params8.1B
Context256K
Best fitQ3_K_M 5.6 GB
RoleplayVision
QW
Bella Bartender Qwen3 1.7b
Qwen · mradermacher
Params1.72B
Context40K
Best fitQ6_K 2.9 GB
ReasoningTool use
GW
Vt Gwen 2.5 3b Q4_k_m Gguf
Gwen · vinhnx90
Params3.09B
Context32K
Best fitQ4_K_M 2.7 GB
GGUF
GM
GmshNet 8B v0.1
Gmshnet · hexera-org
Params7.62B
Context32K
Best fitQ4_1 5.8 GB
CodingReasoning
MI
dolphin 2.8 mistral 7b v02
Mistral · QuantFactory
Params7.24B
Context32K
Best fitQ4_K_M 5.9 GB
GGUF
QW
Models Qwen Qwen2 Math 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context4K
Best fitQ4_K_M 5.7 GB
GGUF
LL
Replete Coder V2 Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Best fitIQ4_XS 6.0 GB
Coding
MI
teknium_hermes-trismegistus-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Best fitQ4_K_M 5.9 GB
Tool use
MI
Chinese Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.5B
Context32K
Best fitQ4_0 5.9 GB
GGUF
LL
Llama3.3 8B Instruct Thinking Claude 4.5 Opus High Reasoning
Llama · mradermacher
Params8B
Context128K
Best fitIQ4_XS 6.0 GB
ReasoningRoleplay

Other memory sizes

Keep browsing