GGUF models that fit in 8 GB
151917 GGUF language models have at least one quant whose estimated memory use is 8 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3 Jan v1 256k Ctx 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context256K
Best fitQ6_K 7.2 GB
MI
Mistral 7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Best fitQ6_K 7.5 GB
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Best fitQ6_K 7.2 GB
JI
JiuZhou
Jiuzhou · mradermacher
Params7.5B
Context32K
Best fitQ6_K 7.7 GB
AL
AlphaMonarch 7B i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Best fitQ6_K 7.5 GB
GP
gpt2
Gpt · mradermacher
Params163M
Context1K
Best fitF16 1.1 GB
LL
Reasoning Llama 1b v0.1
Llama · bartowski
Params1.24B
Context128K
Best fitF16 3.2 GB
LL
dolphin 2.9 llama3 8b 256k GGUF smashed
Llama · PrunaAI
Params8B
Context512K
Best fitQ5_1 7.6 GB
JE
JEV 27B VL
Jev · PALLER-NOVUS
Params27B
Context256K
Best fitQ1_0 7.3 GB
LL
CodeLlama 7b Instruct Solidity i1
Llama · mradermacher
Params6.74B
Context16K
Best fitIQ3_M 7.9 GB
QW
Qwen3.5 9B The Defiant Fable DARK ROAST Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Best fitQ4_K_M 7.4 GB
CO
CodeQwen1.5-7B-Chat
Codeqwen · bartowski
Params7.25B
Context64K
Best fitQ6_K 7.4 GB
QW
Qwen3 1.7B Coder Distilled SFT
Qwen · reaperdoesntknow
Params2.03B
Context40K
Best fitF16 5.5 GB
ST
stable code instruct 3b
Stable · QuantFactory
Params2.8B
Context16K
Best fitQ8_0 6.2 GB
GR
granite 4.2 8b heretic
Granite · saidutta69
Params8.79B
Context128K
Best fitQ4_K_M 7.2 GB
LL
Llama 3.2 uncensored erotica
Llama · hungng
Params3.21B
Context128K
Best fitF16 7.9 GB
SM
Biggie SmoLlm 0.15B Base
SmolLM · mradermacher
Params181M
Context2K
Best fitF16 1.1 GB
MA
MN 12B Mag Mell R1 Uncensored Scale1.2 i1
Mag · mradermacher
Params12.2B
Context1000K
Best fitQ3_K_M 7.9 GB
LF
LFM2.5 1.2B Nova Function Calling
Lfm · NovachronoAI
Params1.17B
Context125K
Best fitQ8_0 2.8 GB
GE
Gemma 4 E4B It Uncensored
Gemma · mradermacher
Params7.52B
Context128K
Best fitQ5_K_M 7.7 GB
DA
Darwin 36B Opus ABLITERATED HERETIC
Darwin · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
OpenHermes 2.5 Mistral 7B Orca DPO
Mistral · mradermacher
Params7.24B
Context32K
Best fitQ6_K 7.5 GB
GL
Glm Oss 8b
GLM · mradermacher
Params8B
Context128K
Best fitQ5_K_M 7.3 GB
FL
d3-flash Artemis 4.6GB
Flash · turintech
Params8.95B
Context256K
Best fitIQ4_XS 6.4 GB
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · mradermacher
Params8.19B
Context40K
Best fitQ5_K_M 7.6 GB
RU
RusMind Malysh 4.7
Rusmind · mradermacher
Params752M
Context256K
Best fitQ4_1 1.5 GB
QW
Qwen3.5 9b Triple Loop Fase2
Qwen · mradermacher
Params8.95B
Context256K
Best fitQ5_K_M 8.0 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Best fitIQ1_M 7.6 GB
LL
Llama 3 ELYZA JP 8B
Llama · elyza
Params8B
Context8K
Best fitQ4_K_M 6.5 GB
AS
Aspire 8B model stock i1
Aspire · mradermacher
Params8B
Context8K
Best fitQ5_K_M 7.3 GB