Vision GGUF models
17604 GGUF models: models that read images through an mmproj file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5 27B Uncensored Heretic v2 Native MTP Preserved
Qwen · llmfan46
Params461M
Context256K
Q4_K_M17.2 GB
GE
Gemma 4 E2B it qat NVFP4
Gemma · WhiskyAKM
Params4.63B
Context128K
Smallest0.1 GB
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
QW
imajev 2b
Qwen · mindchain
Params1.88B
Context256K
Q4_K_M1.3 GB
GR
Groot 65B A6B 261023
Groot · mradermacher
Params118B
Context256K
Q4_K_M79.7 GB
GE
Gemma 4 26B A4B StyleTune V2 QAT
Gemma · alexisStacksCode
Params25.2B
Context128K
Smallest0.3 GB
MI
MiniCPM V 4.7 35B A3B Abliterated
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MO
Dreamaiai 27B 03
Moon · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RD
RDT2 VQ
Rdt · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.5 9B Heretic Ara v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
IR
Iris Mini
Iris · IsValorum
Params35.5B
Context256K
Smallest15.3 GB
QW
Qwen3 VL 8B Instruct Unredacted MAX
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
BO
Bonsai 2 27b VL Uncensored PTQ1 PTQ2 MTP
Bonsai · W-Zil
Params27B
Context256K
Smallest5.9 GB
QW
Qwen 3.8 flash next heretic 3.78bpw
Qwen · soyaakinohara
Params177B
Context256K
Smallest83.6 GB
SC
Scarlet Shadow 31B
Scarlet · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
ST
StartLux-Decision-v1.1-2B-Instant
Startlux · startlux-models
Params1.88B
Context256K
Q4_K_M1.3 GB
GR
Grug 35b v2
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
GE
Coder3101_Gemma_4_31B_It_Heretic
Gemma · Stabhappy
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 26B A4B QAT Voice GGUFs
Gemma · alexisStacksCode
Params25.2B
Context128K
Smallest0.3 GB
QW
Qwen3.5 9B Artemis
Qwen · turintech
Params8.95B
Context256K
Q4_K_M5.7 GB
MI
Ministral 3 14B Instruct 2512 BF16
Mistral · EnlistedGhost
Params13.5B
Context256K
Q4_K_M8.8 GB
GE
Huihui Gemma 4 12B Coder Fable5 Composer2.5 v1 Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
SI
InnerJev 27B Full
Sii · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.5-0.8B
Qwen · NobodyWho
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3.5-35B-A3B
Qwen · Mungert
Params34.7B
Context256K
Q4_K_M21.6 GB
QW
Qwen3.6 35B A3B Heretic Cerebellum
Qwen · deucebucket
Params34.7B
Context256K
Smallest12.0 GB
QW
Qwen3-Vl-235B-A22B-Thinking
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
PP
pplx decider flash v1.2
Pplx · Jakevin
Params4.84B
Context256K
Q4_K_M3.1 GB
GE
Gemma 4 E2B It Ultra Uncensored Heretic
Gemma · princepppp
Params4.65B
Context128K
Q4_K_M3.4 GB
OR
Ornith 1.5 122B
Ornith · prithivMLmods
Params125B
Context256K
Q4_K_M75.8 GB