All GGUF models
206,171 models with specs, quants and memory estimates.
GE
Gemma4-31B-QAT-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 Omni 3B
Qwen · ggml-org
Params3.4B
Context32K
Q4_K_M2.1 GB
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.6-27B
Qwen · ggml-org
Params26.9B
Context256K
Q4_K_M19.1 GB
QW
Huihui Qwen3 Coder 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
HE
Hermes 4 14B
Hermes · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
MI
Devstral-Small-2-24B-Instruct-2512
Mistral · unsloth
Params23.6B
Context384K
Q4_K_M14.3 GB
QW
Qwen3.5-9B
Qwen · unsloth
Params9.2B
Context256K
Q4_K_M5.9 GB
BT
BTL 4 Compact
Btl · badtheorylabs
Params34.7B
Context256K
Smallest10.0 GB
MU
Homura 30B
Muse · hyrelabs
Params28B
Context128K
Q4_K_M16.9 GB
NE
Nemotron 3 Embed 1B Q4 K M
Nemotron · zenmagnets
Params1.14B
Context256K
Q4_K_M0.7 GB
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · llmfan46
Params35.5B
Context256K
Q4_K_M21.8 GB
GR
grug 27b qat q4
Grug · ProCreations
Params27B
Context256K
Q4_K_M16.5 GB
GE
Gemma 4 31B It Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 4b It
Gemma · ggml-org
Params3.88B
Context128K
Q4_K_M2.5 GB
NA
Nanbeige4.3 33B
Nanbeige · bartowski
Params33.1B
Context512K
Q4_K_M20.8 GB
GE
Gemma 4 31B It Abliterated
Gemma · paperscarecrow
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Google_Gemma 4 31B It Qat Q4_0 Unquantized
Gemma · lmstudio-community
Params30.7B
Context256K
Smallest17.7 GB
QW
Huihui Qwen3.8 Flash Next Abliterated
Qwen · mradermacher
Params177B
Context256K
Smallest80.4 GB
QW
Qwen3.5 9B Abliterated
Qwen · lukey03
Params8.95B
Context256K
Q4_K_M5.6 GB
CL
Clef-Flash
Clef · ggml-org
Params9.08B
Context256K
Q4_K_M6.7 GB
MO
MOSS-Music-8B
Moss · nerualdreming
Params8.19B
Context40K
Q4_K_M5.2 GB
GE
gemma 4 31B it qat
Gemma · unsloth
Params480M
Context128K
Smallest0.3 GB
GR
Granite 4.0 1B BE
Granite · taronaeo
Params1.63B
Context—
Q4_K_M1.0 GB
GE
gemma-4-12B-it
Gemma · ggml-org
Params11.9B
Context256K
Smallest0.3 GB
QW
Qwen2.5 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2.5 VL 7B Instruct
Qwen · ggml-org
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.8 Flash Next Uncensored Gufo Q4Mix
Qwen · vmlinux
Params177B
Context256K
Smallest109.8 GB
LL
Meta Llama 3.1 8B Instruct
Llama · lmstudio-community
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 3B Instruct
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB