Vision GGUF models
17604 GGUF models: models that read images through an mmproj file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
GL
GLM OCR
GLM · mradermacher
Params891M
Context128K
Q4_K_M0.5 GB
QW
Qwen2.5 VL 32B Instruct Heretic
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
Qwen3.6 35B A3B
Qwen · byteshape
Params35.5B
Context256K
Smallest10.0 GB
RE
Reggie v2 7b
Reggie · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ZD
TaichuAI/ZDTaichu5.0-9B
Zdtaichu · ngquocvinh
Params8.95B
Context256K
Q4_K_M5.6 GB
IN
InternVL3_5 30B A3B
Internvl · bartowski
Params30.5B
Context40K
Q4_K_M18.6 GB
GE
Gemma 4 E4B xReadable zhTW OCR v1
Gemma · xCloudinfo
Params7.46B
Context128K
Q4_K_M5.3 GB
MO
moondream2
Moondream · moondream
Params1.42B
Context2K
Smallest2.8 GB
QW
DarkIdol Qwen3.8 27B v1.1
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5-27B
Qwen · unsloth
Params27.3B
Context256K
Q4_K_M17.1 GB
MI
MiniMax-3.1-Flash-DeRisked
Minimax · freakyskittle
Params426B
Context1024K
Q4_K_M258.0 GB
QW
Qwen3.8-Flash-Next GSQ-RCO Coder
Qwen · DatKurai
Params117B
Context256K
Smallest58.7 GB
GA
GameScaling 27B S3
Gamescaling · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B
Nemotron · lmstudio-community
Params74B
Context256K
Smallest22.0 GB
GA
GameScaling 9B S1
Gamescaling · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 Omni 30B A3B Captioner
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
MI
mistralai_Ministral 3 8B Instruct 2512 BF16
Mistral · lmstudio-community
Params8.49B
Context256K
Q4_K_M5.2 GB
GE
Gemma 4 12B It Qat Q4_0 Uncensored Heretic v3
Gemma · OS-Software
Params11.9B
Context256K
Smallest6.7 GB
QW
Qwen3.8-27B
Qwen · rax4901
Params27.3B
Context256K
Q4_K_M16.6 GB
LE
LensVLM 9B
Lensvlm · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · LouLou-0
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Huihui Qwen3.5 0.8B Abliterated
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
MI
Devstral Small 2 24B Instruct 2512
Mistral · ggml-org
Params23.6B
Context384K
Smallest25.1 GB
GE
Gemma 4 Dark Thoughts 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
QW
Qwen3 VL Embedding 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.8-27B
Qwen · loscrossos
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.5 35B A3B ultra uncensored heretic
Qwen · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen Qwen3 VL 8B Instruct Heretic
Qwen · ThalisAI
Params8.19B
Context256K
Q4_K_M5.0 GB
NE
NVIDIA-Nemotron-3.5-Bolt-E4B
Nemotron · AtomicChat
Params7.52B
Context64K
Q4_K_M5.1 GB
GE
Gemma 3 4B VL It Gemini Pro Heretic Uncensored Thinking
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB