Vision GGUF models
17604 GGUF models: models that read images through an mmproj file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Huihui Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Swift 1.5 Qwen3.8 27B
Qwen · ukisai
Params27.3B
Context256K
Q4_K_M17.4 GB
MU
Muse Glimmer 30B
Muse · meta-models
Params27.9B
Context128K
Q4_K_M1.6 GB
QW
Qwen3-Vl-8B-Instruct
Qwen · unsloth
Params8.19B
Context256K
Q4_K_M5.0 GB
AG
Agents A1 4B
Agents · InternScience
Params4.21B
Context256K
Smallest4.5 GB
GE
gemma 4 26B A4B it qat q4 0
Gemma · google
Params25.2B
Context256K
Smallest14.4 GB
GE
humanizer-12b
Gemma · jialinyyzz
Params11.9B
Context256K
Q4_K_M7.6 GB
QW
Qwen3.5 9B
Qwen · bartowski
Params9.2B
Context256K
Q4_K_M6.2 GB
QW
Qwen3Vl 2b Instruct
Qwen · Qwen
Params1.72B
Context256K
Q4_K_M1.1 GB
AG
Agents A1 4B
Agents · InternScience
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
gemma 4 E2B it qat q4 0
Gemma · google
Params4.63B
Context128K
Smallest3.3 GB
QW
Qwen3.6 35B A3B
Qwen · bartowski
Params35.5B
Context256K
Q4_K_M22.3 GB
GE
gemma 4 26B A4B it qat
Gemma · unsloth
Params430M
Context128K
Smallest0.3 GB
QW
Qwen3.5-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.7 GB
SA
Sage A1.5 Q8 0
Sage · InternScience
Params35.5B
Context256K
Smallest37.8 GB
QW
Qwen3.8 Flash Next Uncensored i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
GE
gemma-4-E2B-it
Gemma · ggml-org
Params4.65B
Context128K
Smallest0.1 GB
QW
Qwen_Qwen3.5 4B
Qwen · lmstudio-community
Params4.21B
Context256K
Q4_K_M2.7 GB
OR
Ornith 1.5 122B
Ornith · unsloth
Params125B
Context256K
Smallest40.4 GB
QW
Swift 1.5 Qwen3.8 Flash Next
Qwen · ukisai
Params177B
Context256K
Q4_K_M119.6 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B 24GB
Nemotron · nvidia
Params74B
Context256K
Smallest22.0 GB
QW
Holo 3.1 35B A3B
Qwen · Hcompany
Params34.7B
Context256K
Q4_K_M21.3 GB
TE
Ternary Bonsai 2 27B Uncensored Heretic
Ternary · OS-Software
Params27B
Context256K
Smallest5.9 GB
QW
Qwen_Qwen3.6 35B A3B
Qwen · lmstudio-community
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwopus3.6 27B Coder Compat MTP
Qwopus · Jackrong
Params27B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Uncensored
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
QW
Qwen Qwen3.6 27B
Qwen · batiai
Params27B
Context256K
Q4_K_M16.5 GB
KI
Kimi-K2.7-Code
Kimi · unsloth
Params1030B
Context256K
Smallest303.9 GB
EM
Embeddinggemma 2
Embeddinggemma · unsloth
Params271M
Context256K
Smallest0.2 GB
GE
gemma-4-E4B-it
Gemma · ggml-org
Params7.5B
Context128K
Smallest0.1 GB