GGUF models that fit in 8 GB

151917 GGUF language models have at least one quant whose estimated memory use is 8 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Jan v1 256k Ctx 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context256K
Best fitQ6_K 7.2 GB
Coding
MI
Mistral 7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Best fitQ6_K 7.5 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Best fitQ6_K 7.2 GB
GGUF
JI
JiuZhou
Jiuzhou · mradermacher
Params7.5B
Context32K
Best fitQ6_K 7.7 GB
GGUF
AL
AlphaMonarch 7B i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Best fitQ6_K 7.5 GB
GGUF
GP
gpt2
Gpt · mradermacher
Params163M
Context1K
Best fitF16 1.1 GB
GGUF
LL
Reasoning Llama 1b v0.1
Llama · bartowski
Params1.24B
Context128K
Best fitF16 3.2 GB
Reasoning
LL
dolphin 2.9 llama3 8b 256k GGUF smashed
Llama · PrunaAI
Params8B
Context512K
Best fitQ5_1 7.6 GB
GGUF
JE
JEV 27B VL
Jev · PALLER-NOVUS
Params27B
Context256K
Best fitQ1_0 7.3 GB
Vision
LL
CodeLlama 7b Instruct Solidity i1
Llama · mradermacher
Params6.74B
Context16K
Best fitIQ3_M 7.9 GB
Coding
QW
Qwen3.5 9B The Defiant Fable DARK ROAST Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Best fitQ4_K_M 7.4 GB
CodingReasoningRoleplay
CO
CodeQwen1.5-7B-Chat
Codeqwen · bartowski
Params7.25B
Context64K
Best fitQ6_K 7.4 GB
GGUF
QW
Qwen3 1.7B Coder Distilled SFT
Qwen · reaperdoesntknow
Params2.03B
Context40K
Best fitF16 5.5 GB
CodingReasoningTool use
ST
stable code instruct 3b
Stable · QuantFactory
Params2.8B
Context16K
Best fitQ8_0 6.2 GB
Coding
GR
granite 4.2 8b heretic
Granite · saidutta69
Params8.79B
Context128K
Best fitQ4_K_M 7.2 GB
ReasoningRoleplayTool use
LL
Llama 3.2 uncensored erotica
Llama · hungng
Params3.21B
Context128K
Best fitF16 7.9 GB
GGUF
SM
Biggie SmoLlm 0.15B Base
SmolLM · mradermacher
Params181M
Context2K
Best fitF16 1.1 GB
GGUF
MA
MN 12B Mag Mell R1 Uncensored Scale1.2 i1
Mag · mradermacher
Params12.2B
Context1000K
Best fitQ3_K_M 7.9 GB
Reasoning
LF
LFM2.5 1.2B Nova Function Calling
Lfm · NovachronoAI
Params1.17B
Context125K
Best fitQ8_0 2.8 GB
Tool use
GE
Gemma 4 E4B It Uncensored
Gemma · mradermacher
Params7.52B
Context128K
Best fitQ5_K_M 7.7 GB
ReasoningTool use
DA
Darwin 36B Opus ABLITERATED HERETIC
Darwin · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B Orca DPO
Mistral · mradermacher
Params7.24B
Context32K
Best fitQ6_K 7.5 GB
Tool use
GL
Glm Oss 8b
GLM · mradermacher
Params8B
Context128K
Best fitQ5_K_M 7.3 GB
GGUF
FL
d3-flash Artemis 4.6GB
Flash · turintech
Params8.95B
Context256K
Best fitIQ4_XS 6.4 GB
ReasoningTool use
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · mradermacher
Params8.19B
Context40K
Best fitQ5_K_M 7.6 GB
GGUF
RU
RusMind Malysh 4.7
Rusmind · mradermacher
Params752M
Context256K
Best fitQ4_1 1.5 GB
ReasoningTool use
QW
Qwen3.5 9b Triple Loop Fase2
Qwen · mradermacher
Params8.95B
Context256K
Best fitQ5_K_M 8.0 GB
ReasoningTool use
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Best fitIQ1_M 7.6 GB
GGUF
LL
Llama 3 ELYZA JP 8B
Llama · elyza
Params8B
Context8K
Best fitQ4_K_M 6.5 GB
GGUF
AS
Aspire 8B model stock i1
Aspire · mradermacher
Params8B
Context8K
Best fitQ5_K_M 7.3 GB
GGUF

Other memory sizes

Keep browsing