All GGUF models

206,171 models with specs, quants and memory estimates.

GL
glm 5.3
GLM · antirez
Params754B
Context1024K
Smallest211.1 GB
GGUF
SP
Spark X2.6 4B Abliterated
Spark · SC117
Params4.11B
Context1024K
Q4_K_M2.7 GB
ReasoningTool use
QW
Qwen3 0.6b Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
Reasoning
QW
Whittle Qwen 3.8 35B A3B
Qwen · logic65
Params35.5B
Context256K
Q4_K_M21.3 GB
CodingReasoning
GL
Models Zai Org GLM 4.6V Flash
GLM · MaziyarPanahi
Params9.4B
Context128K
Q4_K_M6.2 GB
GGUF
AG
Agents A1
Agents · InternScience
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
MI
MiniCPM-V-4.7-35B-A3B
MiniCPM · AtomicChat
Params34.7B
Context256K
Smallest10.1 GB
ReasoningTool useVision
GP
Models ArliAI Gpt Oss 20b Derestricted
gpt-oss · MaziyarPanahi
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
MI
mistralai_Ministral 3 3B Instruct 2512 BF16
Mistral · lmstudio-community
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
NE
NeoHorse 1 4B
Neohorse · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
MU
Muse Glimmer 30B
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
Vision
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · OBLITERATUS
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
QW
Qwen3 Next 80B A3B Instruct
Qwen · Qwen
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
GL
cerebras/GLM-4.7-Flash-REAP-23B-A3B
GLM · unsloth
Params23B
Context198K
Q4_K_M14.1 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO Uncen IQ1 332Exp
Qwen · DatKurai
Params134B
Context256K
Smallest60.7 GB
Tool useVision
OR
Ornith 1.5 9B Heretic v2
Ornith · Thunder13240
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
MI
mistralai_mixtral-8x7b-instruct-v0.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
JI
JiRackUltra 1b
Jirackultra · CMSManhattan
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
Reasoning
NA
Nanbeige4.3 33B UNCENSORED
Nanbeige · dealignai
Params33.1B
Context512K
Q4_K_M20.1 GB
ReasoningTool use
MI
Devstral Small 2 24B Instruct 2512
Mistral · bartowski
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding
QW
Qwen3 VL 2B Instruct
Qwen · ggml-org
Params1.72B
Context256K
Smallest1.8 GB
Vision
LL
codellama_codellama-7b-instruct-hf
Llama · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GP
Huihui Gpt Oss 20b Mxfp4 Abliterated v2
gpt-oss · huihui-ai
Params20.9B
Context128K
Smallest13.8 GB
GGUF
MI
MistralRP Noromaid NSFW Mistral 7B
Mistral · Ttimofeyka
Params7.24B
Context32K
Smallest4.1 GB
GGUF
QW
Qwen3.8 27B Uncensored
Qwen · BnhHo
Params27.3B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.8 Flash Next
Qwen · agentionai
Params177B
Context256K
Smallest93.5 GB
Vision
QW
RVN Qwen3.8 Flash Next Abliterated Uncensored
Qwen · 0bserverx
Params177B
Context256K
Q4_K_M119.2 GB
GGUF
QW
Qwen3.8-27B-DFlash2
Qwen · incoai
Params1.92B
Context256K
Q4_K_M1.1 GB
GGUF

Jump to a hub