All GGUF models

206,171 models with specs, quants and memory estimates.

QW
Qwen3 Next 80B A3B Instruct
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
GGUF
QW
Qwen3.5-2B
Qwen · unsloth
Params1.94B
Context256K
Q4_K_M1.3 GB
Vision
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · nvidia
Params3.97B
Context1024K
Q4_K_M2.8 GB
Tool use
QW
Qwen_Qwen3.5 0.8B
Qwen · lmstudio-community
Params752M
Context256K
Q4_K_M0.5 GB
Vision
HO
Holo4 27B
Holo · Hcompany
Params27B
Context256K
Q4_K_M16.9 GB
Vision
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · AtomicChat
Params32.9B
Context1024K
Q4_K_M25.0 GB
ReasoningTool use
QW
Z Image Qwen 3 4b text encoder
Qwen · worstplayer
Params4B
Context40K
Smallest2.1 GB
Coding
QW
Qwen2.5 VL 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
LL
testmod koen llama2 13b dpotrain testver
Llama · RichardErkhov
Params13B
Context—
Q4_K_M0.0 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored HauhauCS MTP
Qwen · morikomorizz
Params447M
Context256K
Smallest15.9 GB
Vision
QW
Qwen3 8B Abliterated
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
KI
Kimi Linear 48B A3B Instruct
Kimi · bartowski
Params49.1B
Context1024K
Q4_K_M30.1 GB
GGUF
QW
Qwen3 8B Hivemind Instruct Heretic Abliterated Uncensored NEO Imatrix
Qwen · DavidAU
Params7.66B
Context256K
Q4_K_M4.7 GB
Roleplay
OR
Ornith 1.5 9B
Ornith · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
QW
Qwen2.5 Coder 32b Instruct Heretic Sft
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QW
Huihui Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Huihui gemma 4 E4B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params7.46B
Context128K
Smallest0.2 GB
Vision
FL
flux2 klein 9b uncensored text encoder
Flux · ponpoke
Params8.19B
Context—
Q4_K_M5.0 GB
Coding
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · huihui-ai
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
Qwen3 0.6B Heretic Heresy Edition
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
JA
Jais-3-32B
Jais · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
ReasoningTool use
QW
Qwen3.5 4B Uncensored LocalAI
Qwen · weareapexcreators
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
QW
Qwen3.6 35B A3b pruned v2
Qwen · gatilin
Params26.6B
Context256K
Smallest16.3 GB
GGUF
QW
Huihui Qwen3 VL 30B A3B Instruct Abliterated
Qwen · noctrex
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
XY
XYZ Aquila Mini
Xyz · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
HU
Hunyuan MT 7B
Hunyuan · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
LF
LFM3 1.7B
Lfm · LiquidAI
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
LL
Llama 3.3 70B Instruct
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
AR
BAAI AREX 2
Arex · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
ReasoningTool useVision

Jump to a hub