GGUF models that fit in 8 GB

151917 GGUF language models have at least one quant whose estimated memory use is 8 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B Cold Fusion GAIN Heretic
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
QW
ThinkingCap Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
QW
qwen3 tts 12hz 1.7b ru stress
Qwen · sknyazev
Params142M
Context32K
Best fitF16 3.5 GB
GGUF
AM
Amaretto 14B
Amaretto · mradermacher
Params13.5B
Context256K
Best fitQ3_K_S 7.9 GB
Tool use
QW
Qwen3.5 4B Claude 3xMerge Jackrong UNCENSORED Heretic
Qwen · mradermacher
Params4.21B
Context256K
Best fitQ6_K 5.1 GB
ReasoningTool use
GR
granite-3b-code-instruct
Granite · mradermacher
Params3.48B
Context2K
Best fitQ6_K 6.0 GB
CodingTool use
MI
MiniCPM o 2 6
MiniCPM · openbmb
Params7.6B
Context32K
Best fitQ6_K 7.2 GB
Vision
MI
Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Best fitQ6_K 7.5 GB
GGUF
JA
japanese stablelm instruct beta 7B
Japanese · TheBloke
Params6.74B
Context4K
Best fitQ3_K_S 7.7 GB
GGUF
MI
Mistral Nemo Instruct 2407 abliterated
Mistral · QuantFactory
Params12.2B
Context1000K
Best fitQ3_K_M 7.9 GB
GGUF
HU
Huihui Ornith 1.5 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Best fitQ5_K_M 8.0 GB
Vision
MI
Voxtral Mini 3B 2507
Mistral · bartowski
Params4.01B
Context128K
Best fitQ8_0 5.8 GB
Vision
OP
openchat_openchat-3.5-1210
Openchat · TheBloke
Params7.24B
Context8K
Best fitQ6_K 7.5 GB
Coding
MI
MiniCPM V 4_6 Thinking
MiniCPM · openbmb
Params752M
Context256K
Best fitF16 2.4 GB
ReasoningVision
AE
AesCode 8B
Aescode · mradermacher
Params8.19B
Context256K
Best fitQ5_K_M 7.6 GB
Coding
JI
Jina Embeddings v5 Text Nano Text Matching
Jina · jinaai
Params212M
Context8K
Best fitF16 1.2 GB
CodingEmbedding
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · kamjin
Params7.5B
Context128K
Best fitQ5_K_M 7.7 GB
Vision
OR
Ornith 1.0 9B
Ornith · bartowski
Params8.95B
Context256K
Best fitQ3_K_XL 7.6 GB
Vision
LF
LFM3-VL-2B
Lfm · lmstudio-community
Params1.73B
Context125K
Best fitQ8_0 4.0 GB
ReasoningTool useVision
LL
LLaMA Mesh
Llama · bartowski
Params8B
Context128K
Best fitQ5_K_L 7.6 GB
GGUF
QW
Whittle Qwen 3.8 35B A3B
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.3 GB
CodingReasoning
MI
Ministral 3 8B Instruct 2512
Mistral · bartowski
Params8.49B
Context256K
Best fitQ5_K_L 8.0 GB
Vision
BG
Bge Small En v1.5
BGE · ggml-org
Params33M
Context512
Best fitQ8_0 0.7 GB
Embedding
AE
AesCode 8B
Aescode · prithivMLmods
Params8.19B
Context256K
Best fitQ5_K_M 7.6 GB
CodingVision
JA
Jan-nano-128k
Jan · Menlo
Params4B
Context128K
Best fitQ8_0 6.0 GB
GGUF
PH
Phi 3 mini 128k instruct
Phi · QuantFactory
Params3.82B
Context128K
Best fitQ8_0 7.8 GB
Coding
PH
Phi 3 Medium 128k Instruct
Phi · mradermacher
Params14B
Context128K
Best fitIQ3_XS 8.0 GB
Coding
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · Melvin56
Params7.62B
Context128K
Best fitQ6_K 7.2 GB
Reasoning
LF
LFM2.5 8B A1B DSpark Draft v1
Lfm · LiquidAI
Params328M
Context125K
Best fitF16 1.2 GB
GGUF
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · mmnga
Params3.36B
Context8K
Best fitQ8_0 5.4 GB
GGUF

Other memory sizes

Keep browsing