All GGUF models

206,171 models with specs, quants and memory estimates.

GL
GLM 5.3 GGUF DGX Spark
GLM · autotrust
Params563B
Context1024K
Smallest160.8 GB
GGUF
PH
Phi 3 mini 4k instruct GGUF Imatrix smashed
Phi · PrunaAI
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
NE
Nemotron 3 Nano Omni 30B A3B Reasoning APEX
Nemotron · mudler
Params31.6B
Context1024K
Smallest18.0 GB
ReasoningVision
LU
LunaraHome 26B A4B
Lunarahome · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Tool use
QW
Qwen2.5 7B Instruct Abliterated
Qwen · richardyoung
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GE
Gemma 4 Novelist Eclipse 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
QW
Qwen3.8 Flash Next Abliterated Uncensored
Qwen · cc1244578151
Params177B
Context256K
Smallest83.9 GB
CodingReasoningTool use
OR
Ornith 1.5 122B
Ornith · bartowski
Params125B
Context256K
Q4_K_M78.9 GB
Vision
LL
Lexi-Llama-3-8B-Uncensored
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
SA
Sage A1.5 F16
Sage · InternScience
Params35.5B
Context256K
Smallest71.1 GB
CodingTool useVision
QW
Qwopus3.5 9B Coder Templatefix Hf
Qwopus · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
ST
StartLux Decision v1 4B Q8 0
Startlux · startlux-models
Params4.21B
Context256K
Smallest4.5 GB
GGUF
MI
Dolphin3.0 R1 Mistral 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingReasoningTool use
LI
LightOnOCR 3 4B
Lightonocr · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
HA
Harrier Oss v1 0.6b
Harrier · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
GGUF
AI
Airoboros L2 70b 2.2
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.8-27B
Qwen · Greatjedi
Params27B
Context256K
Smallest11.2 GB
GGUF
QW
Qwen3 Omni 30B A3B Captioner
Qwen · presencesw
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
DE
decider 4b
Decider · Mapika
Params4.2B
Context256K
Q4_K_M2.7 GB
GGUF
QW
Qwen3.8 9B Distill Uncensored Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen3-Vl-2B-Thinking
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
ReasoningVision
TR
Translategemma 4b It
Translategemma · SandLogicTechnologies
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
RO
TheDrummer Rocinante XL 16B v1
Rocinante · bartowski
Params16.1B
Context128K
Q4_K_M10.1 GB
GGUF
MI
Minimax-M3
Minimax · unsloth
Params426B
Context1024K
Q4_K_M264.9 GB
Vision
QW
Qwen3.8 Flash Next Uncensored IQ4XS NGQ4
Qwen · cygnal
Params177B
Context256K
Smallest98.4 GB
Vision
QW
Qwen3.5 4B heretic imatrix
Qwen · FadedRedStar
Params334M
Context256K
Q4_K_M2.7 GB
CodingVision
MA
Magnum v4 72b
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
ST
Step 3.5 Flash
Step · ggml-org
Params197B
Context256K
Smallest118.7 GB
GGUF
QW
Qwen3-235B-A22B-Instruct-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
GGUF

Jump to a hub