All GGUF models
206,171 models with specs, quants and memory estimates.
GR
Granite Embedding 107m Multilingual
Granite · bartowski
Params107M
Context512
Q4_K_M0.1 GB
QW
Qwen 3.5 27B Derestricted
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
NasledieLab Qwen3.5 0.8B GPT 6 Astra Luna Fable 5.1 Opus 5.5 distill Karpy
Qwen · aemmeath
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.6 35B A3B Uncensored LocalAI
Qwen · weareapexcreators
Params34.7B
Context256K
Smallest11.7 GB
GR
Granite-4.1-3B
Granite · weareapexcreators
Params3.4B
Context128K
Q4_K_M2.1 GB
FL
flux 3 image klein pup
Flux · unsloth
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 27B WebNovel Writer Zh
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MU
Muse-Glimmer-30B
Muse · AtomicChat
Params27.9B
Context128K
Q4_K_M16.9 GB
QW
DeepSeek V4 Pro Qwen3.5 9B MTP Public 20260801 HF
Qwen · Jackrong
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.5 27B Claude 4.6 Opus Reasoning Distilled Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8-27B
Qwen · weareapexcreators
Params27.3B
Context256K
Smallest10.7 GB
IN
Index Translate 35B A3B preview
Index · IndexTeam
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.5 27B WebNovel Writer zh
Qwen · wcn123
Params27B
Context256K
Q4_K_M16.5 GB
NO
nomic-embed-text-v1
Nomic · nomic-ai
Params137M
Context2K
Q4_K_M0.1 GB
QU
R3GE Quen2.5 7B
Quen · JackFRost0703
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen3 4B Instruct Awq
Qwen · electricpipelines
Params4B
Context40K
Q4_K_M2.5 GB
QW
Qwen3 30B A3B Abliterated
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
LL
Llama-3.1-8B-Instruct
Llama · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
LF
LFM2 2.6B
Lfm · LiquidAI
Params2.57B
Context125K
Q4_K_M1.6 GB
MU
Muse-Glimmer-30B
Muse · weareapexcreators
Params28B
Context128K
Smallest12.4 GB
QW
Qwen2.5 VL 7B Instruct
Qwen · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
qwen2-1_5b-instruct
Qwen · Qwen
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3.8 27B Uncensored FIT
Qwen · SC117
Params27B
Context256K
Smallest7.5 GB
NA
Nanbeige4.3 33B
Nanbeige · abenzerps
Params33.1B
Context512K
Smallest9.9 GB
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Smallest12.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · bartowski
Params1.71B
Context8K
Q4_K_M1.1 GB
QW
Qwen3.5-9B
Qwen · weareapexcreators
Params9.2B
Context256K
Q4_K_M5.9 GB
KI
Kimi-K2-Instruct
Kimi · unsloth
Params1030B
Context128K
Q4_K_M620.8 GB
QW
Qwen2.5 7b Ins v3
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB