GGUF models that fit in 8 GB
151917 GGUF language models have at least one quant whose estimated memory use is 8 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.
WI
ehartford_wizard-vicuna-7b-uncensored
Wizard · TheBloke
Params6.74B
Context2K
Best fitQ3_K_S 7.7 GB
LY
MN 12B Lyra v4
Lyra · Lewdiculous
Params12.2B
Context1000K
Best fitQ3_K_M 7.9 GB
QW
DarkIdol Qwen3.8 27B v1.1
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RU
RusMind 4.7 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Best fitQ8_0 6.1 GB
0G
0GM 1.0 35B A3B 0427
mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · allenai
Params6.9B
Context4K
Best fitQ6_K 7.3 GB
QW
PAW 27B X3.1
Qwen · lackonendes
Params4.86B
Context256K
Smallest0.7 GB
DA
L3 Dark Planet 8B
Dark · DavidAU
Params8B
Context8K
Best fitQ5_K_M 7.3 GB
HE
Hemmingway 1 Uncensored Heretic
Hemmingway · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
OL
Olmo 3.1 32B Think
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
SA
Saiga_Nemo_12B_Sft_M10_D16
Saiga · IlyaGusev
Params12.2B
Context1000K
Best fitQ3_K_M 7.9 GB
EX
EXAONE-4.0-1.2B
Exaone · LGAI-EXAONE
Params1.28B
Context64K
Best fitBF16 3.6 GB
DE
DeepSeek R1 0528 Qwen3 8B heretic
DeepSeek · richardyoung
Params8.2B
Context128K
Best fitQ5_K_M 7.6 GB
PA
MS3.2 PaintedFantasy Visage v2 33B
Paintedfantasy · bartowski
Params33.6B
Context128K
Q4_K_M20.4 GB
QW
Qwen2.5 Coder 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Best fitQ6_K 7.2 GB
DA
Davinci Tool 30B
Davinci · mradermacher
Params30.5B
Context256K
Best fitIQ1_S 7.7 GB
LL
dolphin 2.9.4 llama3.1 8b
Llama · dphn
Params8B
Context128K
Best fitQ5_K_M 7.3 GB
GA
GameScaling 9B S1
Gamescaling · mradermacher
Params8.95B
Context256K
Best fitQ5_K_S 7.9 GB
GL
GLM Z1 9B 0414
GLM · bartowski
Params9.4B
Context32K
Best fitQ5_K_M 7.9 GB
MI
mistralai_Ministral 3 8B Instruct 2512 BF16
Mistral · lmstudio-community
Params8.49B
Context256K
Best fitQ4_K_M 6.8 GB
PH
Phi 2 OmniMatrix i1
Phi · mradermacher
Params2.78B
Context2K
Best fitQ6_K 5.5 GB
NE
NeuralExperiment 7b MagicCoder v7
Neuralexperiment · mradermacher
Params7.24B
Context32K
Best fitQ6_K 7.5 GB
QW
Onego_Osearch_Popular_Wiki_Qwen05B_V2_Merged
Qwen · onegoai
Params494M
Context32K
Best fitQ4_K_M 1.0 GB
QW
Qwen3.5 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen2.5 Coder 0.5B Instruct Gensyn Swarm tall tame panther
Qwen · 0xgr3y
Params494M
Context32K
Best fitF16 1.6 GB
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Best fitQ6_K 3.3 GB
HE
Hermes 4.3 36B
Hermes · bartowski
Params36.2B
Context512K
Q4_K_M21.8 GB
GP
Gpt2 Medium
Gpt · mradermacher
Params406M
Context1K
Best fitQ4_0 1.6 GB
LE
LensVLM 9B
Lensvlm · bartowski
Params8.95B
Context256K
Best fitQ4_K_L 7.8 GB
QW
Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · LouLou-0
Params8.95B
Context256K
Best fitQ4_K_M 7.2 GB