Vision GGUF models
17604 GGUF models: models that read images through an mmproj file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.6 27B
Qwen · DavidAU
Params27B
Context256K
Q4_K_M16.9 GB
QW
Qwen3.8 27B OBLITERATED
Qwen · Tkayyyy702
Params27.3B
Context256K
Q4_K_M16.8 GB
PA
Palette RP 9B 2609 v0.05
Palette · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
IN
JanusCoderV 7B
InternLM · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
GE
Gemma 4 12B It
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Huihui Qwen3.8 27B Abliterated
Qwen · mitkox
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Jevify Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
MA
UI Mate Democua 27B
Mate · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GL
Gliese OCR 7B Post2.0 Final
Gliese · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen2.5 VL 32B Instruct
Qwen · samgreen
Params689M
Context125K
Q4_K_M19.9 GB
NE
Nex-N2.5-mini
Nex · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
GE
Gemma 4 26B A4B It
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GP
OpenGVLab/InternVL3_5-GPT-OSS-20B-A4B-Preview
gpt-oss · aviallon
Params20.9B
Context128K
Q4_K_M15.8 GB
GO
Google_Medgemma 1.5 4b It
Google · Bercraft
Params3.88B
Context128K
Q4_K_M2.5 GB
JU
Jupiter G 8B
Jupiter · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
QW
Qwen3.8 27B Uncensored Aggressive
Qwen · philbert440
Params26.9B
Context256K
Q4_K_M19.0 GB
QW
Qwen3 VL 4B Instruct Unredacted MAX
Qwen · Dani-3
Params4B
Context256K
Smallest4.3 GB
GO
Godoter 27B
Godoter · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Mistral Small 119B 2603 ik
Mistral · AlexanderKyng
Params119B
Context1024K
Smallest67.2 GB
QW
Merkyor/Qwen3.8-27B-Coder390-EfficientThink
Qwen · gsdavidp
Params27.3B
Context256K
Smallest3.2 GB
MT
Mtrini SVL 2.0
Mtrini · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
backup2026 09 20 mudler Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled APEX
Qwen · burningfeet
Params34.7B
Context256K
Smallest11.6 GB
QW
Qwen3 VL 32B Thinking
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
AU
AutoGLM Phone 9B
Autoglm · BlcaCola
Params9.4B
Context64K
Q4_K_M6.2 GB
QW
Qwen3 VL 32B Instruct
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
GL
Gliese OCR 7B Post1.0
Gliese · prithivMLmods
Params7.62B
Context125K
Q4_K_M4.7 GB
BI
BigBang v1
Bigbang · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
EK
Ekbasis Skopos 27B
Ekbasis · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 ASR 1.7B JA Anime Galgame
Qwen · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
QW
Qwen2 VL 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB