Vision GGUF models
17604 GGUF models: models that read images through an mmproj file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
EK
Ekbasis 27B
Ekbasis · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
LF
LFM2.5 VL 3B Heretic
Lfm · AX1Y2JP
Params2.7B
Context125K
Q4_K_M1.7 GB
QW
GLOBE Qwen2.5VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
KI
Kimi-K3
Kimi · 6block
Params2780B
Context1024K
Smallest540.4 GB
QW
kAI Bolt 0.8B
Qwen · Franci11
Params780M
Context256K
Q4_K_M0.6 GB
ME
Medgemma 27b It
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen3.6 35B A3B Fable 5 Distill
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
MI
Mistral-Small-4-119B-2603
Mistral · lmstudio-community
Params119B
Context1024K
Q4_K_M72.2 GB
LL
Llama Joycaption Beta One Hf Llava
Llama · filvyb
Params8B
Context128K
Smallest6.6 GB
MI
MiniCPM V 4.6
MiniCPM · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.8-27B
Qwen · LeeMantras
Params27.3B
Context256K
Q4_K_M16.6 GB
QW
Qwen3.8 27B RANA Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · biennequants
Params8.95B
Context256K
Q4_K_M6.8 GB
HO
Holo4 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
NE
Next Ocr
Next · thelamapi
Params8.19B
Context256K
Smallest8.7 GB
ON
OneDecision VisionGuard 27B SFT
Onedecision · prithivMLmods
Params26.9B
Context256K
Q4_K_M16.5 GB
AG
Agents A1 Hf
Agents · LordNeel
Params34.7B
Context256K
Q4_K_M21.2 GB
SU
Supermuse 30B
Supermuse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
QW
SmartCode Fable 5 CoT Reasoning QKVO Qwen 3.6 27B Distilled
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
TE
Ternary Bonsai 2 9B Hf Bf16
Ternary · mradermacher
Params8.95B
Context256K
Smallest2.9 GB
JU
Judge 31b
Judge · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5-Omni-7B
Qwen · Sci-fi-vy
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
JonathanColetti Qwen3.8 27B Uncensored
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Huihui Qwen3.6 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GL
AutoGLM-Phone-9B-Multilingual
GLM · Mungert
Params9.4B
Context64K
Q4_K_M6.6 GB
QW
Qwen3.8 27B Abliterated
Qwen · prithivMLmods
Params27.3B
Context256K
Smallest10.9 GB
OM
Omega Arsenal 12B
Omega · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
OM
Omega Arsenal 31B Final
Omega · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.6 35B Uncensored HauhauCS 1M MTP Ollama
Qwen · braydenh563
Params35.5B
Context1024K
Q4_K_M21.7 GB
OM
Omega Convergence 27B v1.0
Omega · ReadyArt
Params27.3B
Context256K
Q4_K_M16.8 GB