All GGUF models

206,171 models with specs, quants and memory estimates.

GE
Gemma 3 27b It
Gemma · lmstudio-community
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Ablation 187 Gemma3.Webnovels.Test.Gemma 3 4b
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GR
Granite 4.0 Micro
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
NE
Nex N2.5 mini
Nex · abenzerps
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool useVision
QW
Qwen3.5 9B Heretic v2
Qwen · AIImageStudio
Params8.95B
Context256K
Smallest9.5 GB
Vision
JI
jinen-v1-xsmall-hf
Jinen · togatogah
Params36M
Context1K
Smallest0.0 GB
GGUF
LL
ggml llava v1.5 7b
LLaVA · mys
Params6.74B
Context4K
Smallest4.1 GB
Vision
PH
phi3.5 gutenberg 4B
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
SE
Sexpedition MS3.2 24B
Sexpedition · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
LI
Ling 3.0 tiny abliterated APEX
Ling · SC117
Params7.9B
Context128K
Smallest3.4 GB
GGUF
CO
Confucius4 R2T2
Confucius · netease-youdao
Params1.72B
Context64K
Q4_K_M1.1 GB
Vision
QW
Qwen3.8 27B Abliterated MTP
Qwen · GCSA-AiLab
Params27B
Context256K
Q4_K_M16.5 GB
Vision
TE
Ternary Bonsai 1.7B
Ternary · prism-ml
Params1.72B
Context32K
Smallest0.5 GB
GGUF
QW
Huihui Qwen3 8B Abliterated v2
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
DE
deepseek-ai_deepseek-coder-33b-base
DeepSeek · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
DE
Deepseek-V4-Flash-Vision-Exp
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.4 GB
Vision
DA
L3 Dark Planet 8B
Dark · DavidAU
Params8B
Context8K
Q4_K_M5.1 GB
Roleplay
GE
Gemma 4 26B A4B It Uncensored
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.8 27B Uncensored
Qwen · AtomicChat
Params27.3B
Context256K
Q4_K_M17.1 GB
ReasoningTool useVision
PH
phi 4
Phi · unsloth
Params14.7B
Context16K
Q4_K_M8.9 GB
Coding
ST
stablelm 2 zephyr 1 6b
Stablelm · stabilityai
Params1.64B
Context4K
Smallest1.0 GB
GGUF
QW
Qwen2.5 VL 7B Abliterated Caption It
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3.6 35B A3B heretic moe balanced v2
Qwen · DmitryDB
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · NousResearch
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
MI
dolphin 2.9.3 mistral nemo 12b
Mistral · dphn
Params12.2B
Context1000K
Q4_K_M7.5 GB
CodingTool use
QW
Qwen3 VL Reranker 8B
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
EmbeddingVision
OL
ollama3.1
Ollama · xzlinuxmodels
Params8B
Context128K
Smallest6.6 GB
GGUF
OR
Ornith1.0 9B 3MPER0RR Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
AR
Artemis 31B v1.1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
ON
OneJev 4B
Onejev · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
Vision

Jump to a hub