GGUF models that fit in 8 GB
151917 GGUF language models have at least one quant whose estimated memory use is 8 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.
GE
Google_Gemma 4 E4B It Qat Q4_0 Unquantized
Gemma · lmstudio-community
Params7.46B
Context128K
Best fitQ4_0 7.1 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · TheBloke
Params10.7B
Context4K
Best fitQ3_K_L 7.8 GB
GR
granite-3b-code-base
Granite · mradermacher
Params3.48B
Context2K
Best fitQ6_K 6.0 GB
CA
CantoneseLLM v2.0 8B Thinking Chat Vector Merged
Cantonesellm · mradermacher
Params8.19B
Context40K
Best fitQ5_K_M 7.6 GB
IN
Index Nailong 9B
Index · mradermacher
Params8.95B
Context224K
Best fitQ5_K_M 8.0 GB
MA
mamba 130m hf
Mamba · QuantFactory
Params129M
Context1024K
Best fitQ8_0 0.7 GB
HY
HybridAgent 14B Agentic
Hybridagent · bartowski
Params14.8B
Context32K
Best fitQ2_K 7.6 GB
VI
T VisStar 7B v0.1 i1
Visstar · mradermacher
Params7.29B
Context32K
Best fitQ6_K 7.6 GB
QW
Qwen3.8 27B Escha W2
Qwen · aj9o9
Params6.33B
Context256K
Best fitF16 5.6 GB
MI
Mistral-11B-SynthIAirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Best fitIQ4_XS 7.9 GB
VI
Vietnamese 4B Chat abliterated
Vietnamese · N14QM
Params4.2B
Context256K
Best fitQ8_0 6.1 GB
GE
Gemma 2B Uncensored
Gemma · lemuralabs
Params2.51B
Context8K
Best fitF16 5.7 GB
QW
Huihui Qwen3.5 9B Claude 4.6 Opus Abliterated Heretic
Qwen · mradermacher
Params8.95B
Context256K
Best fitQ5_K_M 8.0 GB
LL
Hermes 2 Theta Llama 3 8B
Llama · NousResearch
Params8B
Context8K
Best fitQ5_K_M 7.3 GB
QW
Qwen2.5 7B Instruct abliterated v2
Qwen · kepom
Params7.6B
Context32K
Best fitQ6_K 7.2 GB
QW
Qwen3.5 2B EmperoAI Qwen3.8 Distill Heretic Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Best fitF16 4.7 GB
PH
phi3.5 gutenberg 4B i1
Phi · mradermacher
Params3.82B
Context128K
Best fitQ6_K 6.9 GB
SA
vagosolutions_sauerkrautlm-7b-hero
Sauerkrautlm · TheBloke
Params7.24B
Context32K
Best fitQ6_K 7.5 GB
GE
gemma 4 hacking
Gemma · deathafteryou
Params7.5B
Context128K
Best fitQ4_K_M 7.2 GB
QW
dnotitia_Smoothie Qwen3 14B
Qwen · Alcoft
Params14.8B
Context40K
Best fitQ2_K 7.6 GB
LL
Llama3-ChatQA-1.5-8B
Llama · legraphista
Params8B
Context8K
Best fitQ5_K 7.3 GB
TM
Tmax v1.1 9b
Tmax · mradermacher
Params8.95B
Context256K
Best fitQ5_K_M 8.0 GB
ED
vllm-d3-edge
Edge · ggml-org
Params748M
Context256K
Best fitBF16 2.2 GB
QW
Qwen2.5 Coder 14B Instruct Uncensored
Qwen · BlossomsAI
Params14.8B
Context32K
Best fitQ2_K 7.9 GB
ST
stablelm tuned alpha 7b i1
Stablelm · mradermacher
Params7.87B
Context4K
Best fitIQ4_XS 8.0 GB
ST
Starcoder
StarCoder · mradermacher
Params15.8B
Context8K
Best fitIQ3_S 7.8 GB
AL
ALoDLM 8B
Alodlm · mradermacher
Params8.19B
Context40K
Best fitQ5_K_M 7.6 GB
QW
Logics SWE Qwen3.6 27B
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
OR
Ornith-1.5-9B-Uncensored
Ornith · vonvonhero
Params8.95B
Context256K
Best fitQ5_K_M 8.0 GB
FI
Fimbulvetr 11B v2 i1
Fimbulvetr · mradermacher
Params10.7B
Context4K
Best fitIQ4_XS 8.0 GB