Vision GGUF models
17604 GGUF models: models that read images through an mmproj file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
NE
Nemotron 3.5 Bolt 74B A9B CRACK 24GB
Nemotron · dealignai
Params74B
Context256K
Smallest1.0 GB
MI
MiniCPM V 4.7 1B
MiniCPM · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
MI
Mistral Medium 3.5 128B
Mistral · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
QW
Qwen3 VL 8B Instruct
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GE
Gemma 3 4b It Heretic Uncensored Abliterated Extreme
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LI
LightOnOCR 3 0.8B
Lightonocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
GE
Gemma 4 12B
Gemma · DhruvalLabs
Params11.9B
Context256K
Q4_K_M7.4 GB
OC
Occamy 1.0 APEX I NanoPlus
Occamy · IsValorum
Params34.7B
Context256K
Q4_K_M1.3 GB
QW
Qwen3Vl 32b Thinking
Qwen · Qwen
Params32.8B
Context256K
Q4_K_M19.8 GB
MI
MiniCPM V 4.7 1B
MiniCPM · NANI-Nithin
Params1.01B
Context256K
Q4_K_M0.7 GB
GE
GELab Zero 4B Preview
Gelab · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
QW
Video Companions
Qwen · off-grid-ai
Params4.02B
Context256K
Q4_K_M2.5 GB
UN
Unlimited OCR 2
Unlimited · AtomicChat
Params2.94B
Context128K
Smallest2.0 GB
GE
Gemma 4 31B It The DECKARD HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8 27B Finance
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
EM
embeddinggemma-2
Embeddinggemma · AtomicChat
Params271M
Context256K
Q4_K_M0.2 GB
OR
Ornith 1.5 27B A3B CoderX MTP
Ornith · ManniX-ITA
Params26.2B
Context256K
Q4_K_M16.1 GB
GE
Gemma 3 27b
Gemma · lmstudio-community
Params27B
Context128K
Smallest15.6 GB
KI
Kimi K3
Kimi · AtomicChat
Params2780B
Context1024K
Smallest589.5 GB
KI
Qwopus3.5 122B A10B Kimi K2.6 destill healed abliterated
Kimi · OpenYourMind
Params125B
Context256K
Q4_K_M75.8 GB
QW
AgentMercury Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GE
Gemma 4 31b It Heretic Ara
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GR
Granite Speech 5.0 2b
Granite · ibm-granite
Params1.84B
Context16K
Q4_K_M1.1 GB
QW
ThinkingCap Qwen3.6 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
QW
Qwen3.6 27B Omnimerge v4
Qwen · ManniX-ITA
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NEO CODER MAX MTP
Qwen · Notyourmom1
Params27B
Context256K
Q4_K_M18.0 GB
GR
Groot 19B A3B 261023
Groot · GrootTeam
Params19B
Context256K
Q4_K_M11.7 GB
GE
Gemma4 Gutenberg 31B Heretic
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
MI
llava v1.6 mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB