Vision GGUF models
17604 GGUF models: models that read images through an mmproj file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
GE
Gemma3 27B It Vl GLM 4.7 Uncensored Heretic Deep Reasoning
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
MI
MiniCPM V 2 6
MiniCPM · second-state
Params7.61B
Context32K
Q4_K_M4.7 GB
QW
Kataguru Sceptic 35B A3B v2.8.1 BF16
Qwen · kataguru
Params35.2B
Context256K
Smallest12.9 GB
QW
Qwen3.5 0.8B
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3 VL 8B Instruct Abliterated v1
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
MO
models moved
Models · Shinewonder
Params27.3B
Context256K
Q4_K_M2.5 GB
GE
Gemma 4 31B IT NVFP4 Src
Gemma · LibertAIDAI
Params30.7B
Context256K
Q4_K_M17.8 GB
GE
Docto Decision Gemma 4 E2B Fr v0.1
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
QW
Qwen3.8 2B Heretic Max
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
UN
UniPercept
Unipercept · AX1Y2JP
Params7.6B
Context32K
Q4_K_M4.7 GB
JI
jina embeddings v5 omni nano retrieval
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · lmstudio-community
Params108B
Context10240K
Q4_K_M67.5 GB
GE
Gemma 4 31B Humanlike Chat
Gemma · LessThanThreeAI
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
GE
Gemma 4 19B A4B It INSTRUCT Heretic Uncensored
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
QW
Qwen3.8 27B OBLITERATED
Qwen · minte1431
Params27.3B
Context256K
Q4_K_M16.8 GB
AV
Avrik Pro 12B
Avrik · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
JE
Jebadiah 9b v2
Jebadiah · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.8B 27B Mix
Qwen · Deathsquad10
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
gemma 3 4b null space abliterated RP writer
Gemma · jwest33
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
MARTHA LXVIII.21b_QWEN 3.5 3.6_prune_27b 3.6_base
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 122B A10B Claude Distill
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
QW
Qwen3.8 27B TURBO MAX
Qwen · Jogmg
Params26.9B
Context256K
Q4_K_M18.0 GB
GE
Gemma 3 4b It Abliterated
Gemma · matrixportalx
Params3.88B
Context128K
Q4_K_M2.5 GB
MI
Ministral 3 3B Claude Opus Reasoning Distilled
Mistral · xtools-at
Params3.43B
Context256K
Q4_K_M2.1 GB
GE
Huihui Gemma 4 E2B It Abliterated v2
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
SW
Swift-1.5-Ornith-9B
Swift · ukisai
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Swift Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Mistral Small 3.2 24B Instruct 2506 Absolute Heresy
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB