Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
SC117 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · jaromer
Params177B
Context256K
Smallest0.9 GB
GR
Granite Vision 3.2 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
WI
Wiguel AI
Wiguel · Miguelms13
Params1.78B
Context—
Smallest1.1 GB
DE
HeatSeeker 284B A13B
DeepSeek · UltimateIntent
Params284B
Context1024K
Q4_K_M171.8 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · Krhuz
Params284B
Context1024K
Smallest10.9 GB
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GR
Granite 3.3 2B Instruct BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Granite 4.0 H Tiny BE
Granite · taronaeo
Params6.94B
Context1024K
Q4_K_M4.2 GB
QW
AlexWortega Qwen3.8 27B antislop
Qwen · zsulysses
Params27.3B
Context256K
Smallest0.0 GB
LI
lingbot map
Lingbot · Asher-1
Params1.16B
Context—
Smallest0.0 GB
QW
Qwen Image 2.1 UC
Qwen · klvnyong
Params7.12B
Context—
Smallest14.2 GB
QW
Qwen3 235B A22B Thinking 2507 i1
Qwen · mradermacher
Params235B
Context256K
Smallest0.5 GB
RE
realistic
Realistic · aufjsufjaujda3
Params11.9B
Context—
Smallest6.9 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · nurdich
Params1.86B
Context256K
Smallest0.9 GB
LI
limite 1b violetto GGUF LiteRT
Limite · Tdamre
Params1.07B
Context—
Q4_K_M0.7 GB
ST
Cerebras Step 3.5 Flash REAP 149B A11B
Step · wimmmm
Params149B
Context256K
Smallest0.4 GB
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · andrijdavid
Params4.43B
Context—
Q4_K_M2.9 GB
DE
DeepSeek V4.1 Flash 1017 UD IQ2XS
DeepSeek · cliecy
Params748B
Context1024K
Smallest0.8 GB
QW
Qwen3.8 27B Parasyte
Qwen · cicalooo
Params27.3B
Context256K
Smallest23.0 GB
TR
Trinity Large TrueBase i1
Trinity · mradermacher
Params399B
Context8K
Smallest0.5 GB
GR
Granite 4.0 3B Vision BE
Granite · taronaeo
Params3.66B
Context128K
Q4_K_M2.2 GB
GE
Gemma 4 12b RedTeam BlackICE
Gemma · ChonkE
Params11.9B
Context256K
Smallest0.5 GB
DE
DeepSeek V4.1 Flash
DeepSeek · JigSawPT
Params755B
Context—
Smallest501.8 GB
PI
pix2tex mfr
Pix · cstr
Params29M
Context—
Smallest0.0 GB
PH
microsoft phi 4 GGUF IQ2 XXS
Phi · sigmanih
Params14.7B
Context16K
Smallest0.0 GB
KR
krea2
Krea · rectangleworm
Params12.8B
Context—
Q4_K_M7.2 GB
GR
Granite Vision 4.1 4B BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
ED
edge0 8b a1b
Edge · cipher-000
Params7.89B
Context128K
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731 Pruned 155B A13B
DeepSeek · takanori-ishikawa
Params155B
Context1024K
Smallest1.2 GB
LI
voxprint t lite it 2.1
Lite · Mitroshenkov87
Params8.19B
Context40K
Smallest0.0 GB