All GGUF models
206,171 models with specs, quants and memory estimates.
CO
Yi Coder 9B Chat
Coder · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
GL
Glm 4 9b Chat
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
LU
G4 LuneLight 31B
Lunelight · zerofata
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 7B Instruct 1M
Qwen · bartowski
Params7.62B
Context986K
Q4_K_M4.7 GB
GR
Granite-4.1-3B
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
QW
Darrellbest Qwen Image 2.1 PE I2I Heretic
Qwen · darrellbest
Params8.95B
Context256K
Q4_K_M5.6 GB
SH
Shadow Siren 14B Pruned
Shadow · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
MI
llava 1.6 mistral 7b
Mistral · cjpais
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Huihui Qwen3.5 4B Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
Wanabi Gemma4 31B
Gemma · kawaimasa
Params30.7B
Context256K
Q4_K_M18.7 GB
NU
nuextract 1.5 tiny mealie ingredient parser
Nuextract · abyrne55
Params494M
Context32K
Smallest0.5 GB
RW
rwkv 6 world 3b
Rwkv · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
YA
YandexGPT 5 Lite 8B Instruct
Yandexgpt · yandex
Params8B
Context32K
Q4_K_M4.9 GB
QW
Qwen3.8 Flash Next
Qwen · FINAL-Bench
Params177B
Context256K
Q4_K_M100.2 GB
WH
whiterabbitneo_whiterabbitneo-33b-v1
Whiterabbitneo · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
QW
Qwen3.8-27B
Qwen · k1lliiviie
Params27.3B
Context256K
Q4_K_M16.6 GB
OR
Ornith 1.5 35B A3B Heretic MTP APEX GSQ RCO
Ornith · lavendercomputing
Params447M
Context256K
Smallest13.4 GB
CE
MN 12B Celeste V1.9
Celeste · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
OrionStar-Yi-34B-Chat-Llama
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
CY
Cydonia 24B v4.2.0
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
DO
dots.ocr
Dots · ggml-org
Params1.78B
Context128K
Smallest1.9 GB
QW
Qwen3.8 Flash Next FLE
Qwen · sirfyyn
Params177B
Context256K
Smallest1.5 GB
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Huihui Qwen3.6 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
CR
Creative Quants
Creative · drakira
Params11.9B
Context256K
Smallest8.6 GB
CO
comfyui full pack
Comfyui · LuckyOda
Params4B
Context40K
Smallest4.3 GB
NO
nousresearch_nous-capybara-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
DA
Darwin 36B Opus
Darwin · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
Minicpm
MiniCPM · trithemius
Params34.7B
Context256K
Smallest15.5 GB