All GGUF models

206,171 models with specs, quants and memory estimates.

QW
Qwen3.6 27B A3B Coder
Qwen · ManniX-ITA
Params26.2B
Context256K
Q4_K_M14.7 GB
CodingVision
QW
Qwen3 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
MI
Dolphin3.0 Mistral 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingTool use
GL
Glm-4.6V
GLM · unsloth
Params107B
Context128K
Q4_K_M70.6 GB
Vision
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
sakura-7b-qwen2.5-v1.0-iq4xs
Qwen · SakuraLLM
Params7.62B
Context128K
Smallest4.3 GB
GGUF
BG
bge reranker v2 m3
BGE · gpustack
Params568M
Context8K
Q4_K_M0.4 GB
Embedding
MI
Ministral-3-3B-Instruct-2512
Mistral · unsloth
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
GL
Zai org_GLM 4.6V Flash
GLM · lmstudio-community
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
GL
GLM 5.3 Flash Maya M Derisked IQ2 S
GLM · peasantsmith
Params321B
Context1024K
Smallest116.0 GB
GGUF
CY
Blackfrost-AI/CYBER-FROST-3.8-BF16
Cyber · freakyskittle
Params177B
Context256K
Q4_K_M2.6 GB
Vision
QW
Qwen_Qwen3 30B A3B Instruct 2507
Qwen · lmstudio-community
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Huihui Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen2.5 Math 1.5B Instruct
Qwen · bartowski
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
LF
LFM2.5 VL 1.6B
Lfm · ente-ai
Params1.17B
Context125K
Q4_K_M0.7 GB
Vision
JE
JevK5
Jevk · alibiserikbay
Params1.88B
Context256K
Q4_K_M2.7 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · lmstudio-community
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
VO
VoxCPM2
Voxcpm · DennisHuang648
Params912M
Context32K
Smallest1.7 GB
GGUF
MI
mistralai_Ministral 3 14B Reasoning 2512
Mistral · lmstudio-community
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningVision
QW
OrcaSAQ 2 Cyber 27B Uncensored
Qwen · orcarouter
Params27.3B
Context256K
Smallest15.7 GB
ReasoningTool use
TE
Ternary Bonsai 2 27B Abliterated
Ternary · Hikari07jp
Params27B
Context256K
Smallest7.2 GB
GGUF
QW
Qwen3 14B Uncensored
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
GE
Gemma 4 Novelist Eclipse 31B
Gemma · bartowski
Params32.1B
Context256K
Q4_K_M20.4 GB
Roleplay
QW
SpaceTimee/Suri-Qwen-3.8-27B-Uncensored
Qwen · SpaceTimee
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
OR
Ornith 1.0 35B Heretic MTP APEX
Ornith · SC117
Params447M
Context—
Smallest0.2 GB
ReasoningVision
DE
Deepseek-V4-Flash
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.5 GB
GGUF
GE
UNSEEN Gemma 4 26B NSFW
Gemma · Jommarn
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
VL
vllm-d3
ggml-org
Params26.9B
Context256K
Q4_K_M19.4 GB
ReasoningTool useVision
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
QW
Qwen3 ASR 0.6B
Qwen · unslothai
Params752M
Context64K
Smallest0.8 GB
Vision

Jump to a hub