GGUF models that fit in 8 GB

151917 GGUF language models have at least one quant whose estimated memory use is 8 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
K2-Horizon-3.7B
Horizon · bartowski
Params5.06B
Context512K
Best fitQ8_0 7.1 GB
GGUF
RU
RusMind 4.6.5 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Best fitQ8_0 6.1 GB
ReasoningTool use
QW
Qwen2.5 Coder 14B Instruct
Qwen · unsloth
Params14.8B
Context32K
Best fitQ2_K 7.9 GB
Coding
QW
hpc assistant qwen3 4b
Qwen · VaibhavKKM
Params4.02B
Context256K
Best fitQ8_0 6.0 GB
Tool use
QW
Qwen3 4B 2507 abliterated
Qwen · prithivMLmods
Params4B
Context256K
Best fitQ8_0 6.0 GB
GGUF
MI
colgrep-agent-2B
MiniCPM · lightonai
Params2.52B
Context128K
Best fitBF16 5.9 GB
CodingTool use
QW
Huihui Qwen3.5 0.8B Abliterated
Qwen · mradermacher
Params752M
Context256K
Best fitF16 2.4 GB
ReasoningTool useVision
SI
Signal 3.8 27B Terse Coder
Signal · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoning
MI
Ministral 3 8B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params8.49B
Context256K
Best fitQ5_K_M 7.7 GB
Reasoning
RN
EssentialAI_rnj 1 Instruct
Rnj · lmstudio-community
Params8.3B
Context32K
Best fitQ4_K_M 6.7 GB
GGUF
QW
Qwen3 VL Embedding 2B
Qwen · mradermacher
Params1.72B
Context256K
Best fitF16 4.9 GB
EmbeddingVision
FA
Falcon 11B
Falcon · mradermacher
Params11.1B
Context2K
Best fitQ3_K_M 7.9 GB
GGUF
PH
Phi 3 Medium 4k Instruct
Phi · bartowski
Params14B
Context4K
Best fitIQ3_XS 8.0 GB
Coding
QW
Qwen Qwen3 VL 8B Instruct Heretic
Qwen · ThalisAI
Params8.19B
Context256K
Best fitQ4_K_M 6.7 GB
Vision
NE
NVIDIA-Nemotron-3.5-Bolt-E4B
Nemotron · AtomicChat
Params7.52B
Context64K
Best fitQ5_K_M 7.4 GB
ReasoningTool useVision
PY
Pygmalion 2 7B
Pygmalion · TheBloke
Params6.74B
Context4K
Best fitQ3_K_S 7.7 GB
GGUF
GE
Gemma 3 4B VL It Gemini Pro Heretic Uncensored Thinking
Gemma · mradermacher
Params3.88B
Context128K
Best fitQ8_0 5.8 GB
ReasoningVision
QW
Qwen3 VL 4B Instruct Uncensored Abliterated
Qwen · mradermacher
Params4.02B
Context256K
Best fitQ8_0 6.0 GB
Tool useVision
QW
Qwen3.8 9B Distill SLERP F451 Pro Writer Uncensored
Qwen · mradermacher
Params9.2B
Context256K
Best fitQ4_1 7.6 GB
Roleplay
DE
decider 2b
Decider · Mapika
Params1.88B
Context256K
Best fitBF16 4.7 GB
GGUF
GR
Granite 4.0 H 350m
Granite · ibm-granite
Params340M
Context1024K
Best fitBF16 2.0 GB
GGUF
MI
Ministral 3 8B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params8.49B
Context256K
Best fitQ5_K_M 7.7 GB
Reasoning
QW
Qwen2-0.5B
Qwen · legraphista
Params494M
Context128K
Best fitBF16 1.6 GB
GGUF
AB
Hy MT2 7B Abliterated Bf16
Abliterated · alexwkleung
Params7.5B
Context256K
Best fitQ6_K 7.7 GB
GGUF
MU
Muse Glimmer 30B Heretic
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
Vision
QW
Qwen3.8-27B
Qwen · qtum
Params27B
Context256K
Best fitQ8_0 5.8 GB
Vision
MU
Muse Glimmer 30B Esper4
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
CodingReasoningVision
GE
Gemma The Writer Mighty Sword 9B
Gemma · DavidAU
Params9.2B
Context8K
Best fitQ3_K_M 7.8 GB
Roleplay
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Best fitQ6_K 7.2 GB
Coding
DE
uncensoredai UncensoredLM DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.2B
Context128K
Best fitQ2_K 7.6 GB
Reasoning

Other memory sizes

Keep browsing