GGUF models that fit in 32 GB
198257 GGUF language models have at least one quant whose estimated memory use is 32 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 4194304K tokens.
LF
LFM2.5-1.2B-Thinking
Lfm · LiquidAI
Params1.17B
Context125K
Best fitBF16 3.9 GB
GE
gemma 4 12B it uncensored
Gemma · TrevorJS
Params11.9B
Context256K
Best fitQ8_0 26.1 GB
QW
Ingot XIII 27B Q2
Qwen · dendriteholdings
Params26.9B
Context256K
Smallest5.9 GB
MU
Music Flamingo Hf
Music · mradermacher
Params7.61B
Context32K
Best fitF16 16.2 GB
MI
MiniCPM V 4.7 35B A3B
MiniCPM · mradermacher
Params34.7B
Context256K
Best fitQ6_K 29.7 GB
QW
Qwen2.5 0.5B Instruct
Qwen · lmstudio-community
Params494M
Context32K
Best fitQ6_K 1.1 GB
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · unsloth
Params30.5B
Context256K
Best fitQ6_K_XL 27.6 GB
QW
Qwen3.5-0.8B
Qwen · unsloth
Params773M
Context256K
Best fitBF16 2.5 GB
QW
Qwen3.8-27B
Qwen · 6block
Params27B
Context256K
Best fitQ8_0 30.7 GB
QW
Qwen3.5 4B NSFW ARA Heretic Literotica i1
Qwen · Sinbad-The-Sailor
Params4.2B
Context256K
Best fitQ6_K 5.0 GB
LL
Nidum Llama 3.2 3B Uncensored
Llama · lemuralabs
Params3.21B
Context128K
Best fitF16 7.9 GB
QW
Huihui Qwen3.5 9B Abliterated
Qwen · Abiray
Params8.95B
Context256K
Best fitQ8_0 11.1 GB
QW
Qwen3.6 35B A3B Anko
Qwen · bartowski
Params34.7B
Context256K
Best fitQ6_K_L 31.5 GB
LL
Llm Jp 4.1 32b A3B Thinking
Llm · llm-jp
Params32B
Context64K
Best fitQ4_K_M 22.6 GB
QW
Qwen_Qwen3 VL 30B A3B Instruct
Qwen · lmstudio-community
Params30.5B
Context256K
Best fitQ6_K 26.4 GB
NA
Nanonets-Ocr-S
Nanonets · unsloth
Params3.1B
Context125K
Best fitBF16 7.0 GB
OR
Ornith
Ornith · pfeifferj
Params34.7B
Context256K
Smallest13.0 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · lmstudio-community
Params15.7B
Context160K
Best fitQ8_0 19.5 GB
QW
Qwen 3 8b Heretic
Qwen · DreamFast
Params8.19B
Context40K
Best fitF16 18.1 GB
GE
gemma 4 12B it heretic QAT
Gemma · SC117
Params11.9B
Context256K
Best fitQ4_K_XL 20.1 GB
GA
GalTransl v4 4B 2601
Galtransl · SakuraLLM
Params4B
Context32K
Smallest2.8 GB
VE
UI Venus 2 9B
Venus · bartowski
Params8.95B
Context256K
Best fitBF16 19.5 GB
QW
Dongfangshuo Qwen3.8 27B NSFW Novel
Qwen · dongfangshuo
Params27B
Context256K
Best fitQ8_0 31.3 GB
MU
Murasaki 4B v0.3
Murasaki · mradermacher
Params4.41B
Context32K
Best fitF16 10.5 GB
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · HeYujie
Params34.7B
Context256K
Best fitQ6_K 29.7 GB
GE
Gemma 3 12b It
Gemma · ggml-org
Params11.8B
Context128K
Best fitF16 27.3 GB
BO
Boulesis v2.1 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Best fitQ6_K 31.8 GB
QW
sakura-14b-qwen3-v1.5
Qwen · SakuraLLM
Params14.8B
Context32K
Smallest8.2 GB
QW
Qwen3.8 27B Heretic Ara
Qwen · mradermacher
Params27.3B
Context256K
Best fitQ8_0 31.7 GB
QW
Qwopus3.8 27B Flash V2 Abliterated
Qwopus · mradermacher
Params27B
Context256K
Best fitQ6_K 24.7 GB