GGUF models that fit in 8 GB

151917 GGUF language models have at least one quant whose estimated memory use is 8 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Tulu 3 8B
Llama · lmstudio-community
Params8B
Context128K
Best fitQ4_K_M 6.5 GB
GGUF
TH
Threnystril v2.0 7B slerp
Threnystril · mradermacher
Params7.24B
Context32K
Best fitQ6_K 7.7 GB
GGUF
LL
Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Best fitQ5_K_M 7.3 GB
GGUF
SO
Solar 10.7B SLERP
Solar · TheBloke
Params10.7B
Context4K
Best fitQ3_K_L 7.8 GB
GGUF
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · legraphista
Params8B
Context8K
Best fitQ5_K 7.3 GB
GGUF
EX
EXAONE 3.5 2.4B Instruct
Exaone · lmstudio-community
Params2.67B
Context32K
Best fitQ8_0 4.0 GB
GGUF
GL
GLM 4.7 Flash Name NSFW
GLM · mradermacher
Params30B
Context198K
Best fitIQ1_S 7.6 GB
GGUF
LL
Emma 500 Llama2 7b
Llama · bartowski
Params6.74B
Context4K
Best fitIQ3_M 7.9 GB
GGUF
AS
astrollama 3 8b chat aic i1
Astrollama · mradermacher
Params8B
Context8K
Best fitQ5_K_M 7.3 GB
GGUF
IQ
IQuest Coder V1 40B Instruct
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
Coding
SE
Seed X PPO 7B
Seed · mradermacher
Params7.51B
Context32K
Best fitQ6_K 7.7 GB
GGUF
QW
Qwen3 VL 4B Instruct Unredacted MAX
Qwen · prithivMLmods
Params4B
Context256K
Best fitQ8_0 6.0 GB
Vision
SK
Skywork OR1 Math 7B
Skywork · bartowski
Params7.62B
Context128K
Best fitQ6_K_L 7.5 GB
GGUF
IN
Internlm2 Math Base 7b
InternLM · mradermacher
Params7.74B
Context8K
Best fitQ6_K 7.9 GB
GGUF
PR
PreciseCoder 4B
Precisecoder · mradermacher
Params4.21B
Context256K
Best fitQ6_K 5.0 GB
Coding
MO
Moonlight 16B A3B Instruct
Moonlight · gabriellarson
Params16B
Context8K
Best fitQ2_K 7.6 GB
GGUF
QW
Qwen2 Math 1.5B Instruct
Qwen · legraphista
Params1.54B
Context4K
Best fitBF16 3.8 GB
GGUF
PY
Pythia 160m
Pythia · mradermacher
Params162M
Context2K
Best fitIQ1_S 0.9 GB
GGUF
QW
Vitus Qwen3 14B
Qwen · mradermacher
Params14.8B
Context32K
Best fitIQ3_XXS 7.8 GB
ReasoningTool use
IN
Index Nailong 2B
Index · mradermacher
Params1.88B
Context256K
Best fitQ6_K 2.5 GB
GGUF
GP
Gpt Oss Sanguine 20b v1
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
CodingReasoningRoleplay
FL
PornMaster flux2 klein 9b
Flux · VenerableRolliPolli
Params8.19B
Context256K
Best fitQ5_K_M 7.6 GB
GGUF
OL
Olmo-3-1025-7B
OLMo · Mungert
Params7.3B
Context64K
Best fitIQ2_M 7.7 GB
GGUF
QW
Qwen3 Reranker 0.6B
Qwen · mradermacher
Params596M
Context40K
Best fitF16 2.6 GB
Embedding
QW
Qwen3 Esper3 Reasoning CODER Instruct 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context40K
Best fitQ6_K 7.2 GB
CodingReasoning
GE
Winnow E2B
Gemma · EldanRing
Params77M
Context128K
Best fitQ8_0 5.5 GB
Vision
QW
Huihui Qwen3.5 9B Abliterated
Qwen · interimlabs
Params8.95B
Context256K
Smallest5.6 GB
GGUF
QW
Qwen3 30B A3B ERP v0.1
Qwen · Aratako
Params30.5B
Context32K
Best fitIQ1_S 7.7 GB
GGUF
CH
Chaotic Order V4
Chaotic · mradermacher
Params23.6B
Context128K
Best fitIQ1_M 7.6 GB
GGUF
NE
Nemotron-3.5-Bolt-E4B-Heretic
Nemotron · grumd0
Params7.46B
Context64K
Best fitQ5_K_XL 7.7 GB
ReasoningTool useVision

Other memory sizes

Keep browsing