All GGUF models

206,171 models with specs, quants and memory estimates.

QW
Qwen Image 2.1 Text Encoder Heretic
Qwen · pottokao
Params8.2B
Context256K
Q4_K_M5.0 GB
CodingVision
GE
Gemma-3-4B-It
Gemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
TE
test model router download
Test · ggml-org
Params1M
Context2K
Smallest0.0 GB
GGUF
GE
Google_Gemma 4 26B A4B It Qat Q4_0 Unquantized
Gemma · lmstudio-community
Params25.2B
Context256K
Smallest14.4 GB
Vision
LT
LTX 2.3 uncensored v1.4 FP8
Ltx · ChrisColeTech
Params21B
Context128K
Q4_K_M7.3 GB
GGUF
BO
Bonsai-8B
Bonsai · prism-ml
Params8.2B
Context64K
Smallest1.2 GB
GGUF
QW
Qwen3 32B Awq Compatible Instruct
Qwen · Qwen
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
GE
gemma 7b
Gemma · google
Params8.54B
Context—
Smallest34.2 GB
GGUF
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · yuxinlu1
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
MI
MiniCPM V 4.7 1B
MiniCPM · openbmb
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision
GE
gemma 4 31B it qat q4 0
Gemma · google
Params30.7B
Context256K
Smallest17.7 GB
Vision
QW
Qwen3.8 Flash Next REAP 288 Bf16
Qwen · sh0wie
Params124B
Context256K
Q4_K_M83.8 GB
GGUF
QW
Qwen3 0.6B
Qwen · bartowski
Params752M
Context32K
Q4_K_M0.5 GB
GGUF
GE
Gemma 4 E2B
Gemma · lmstudio-community
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
QW
Qwen3.8 Flash Next IQ2_XXS imatrix trunk, padded Q2_K down, MTP
Qwen · antirez
Params188B
Context256K
Smallest147.2 GB
GGUF
EM
embeddinggemma-2
Embeddinggemma · ggml-org
Params271M
Context256K
Smallest0.3 GB
EmbeddingVision
QW
Qwen3.5 4B
Qwen · SoAIHQ
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
QW
Qwen3.5-4B
Qwen · unsloth
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
SU
Supra2 100M Instruct
Supra · SupraLabs
Params101M
Context2K
Smallest0.2 GB
GGUF
DE
Deepseek-R1-Distill-Qwen-1.5B
DeepSeek · unsloth
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
QW
Qwen3.8 27B Jumbo Fusion IQ 747 900 Turbo Brilliance 50X Reasoning Instruct NEO MAX MTP
Qwen · DavidAU
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningRoleplay
LF
LFM2.5 8B A1B
Lfm · LiquidAI
Params8.47B
Context125K
Q4_K_M5.2 GB
GGUF
QW
Qwen3 30B A3B
Qwen · Qwen
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · bartowski
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
QW
nl2sh 1.5b Q4 K M
Qwen · ThorOdinson246
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
GE
Gemma-3-12B-It-Qat
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Qwen3.5 0.8B Artemis
Qwen · turintech
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
LF
LFM2.5-350M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct
Qwen · lmstudio-community
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding

Jump to a hub