Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
SC117 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · jaromer
Params177B
Context256K
Smallest0.9 GB
GGUF
GR
Granite Vision 3.2 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
WI
Wiguel AI
Wiguel · Miguelms13
Params1.78B
Context—
Smallest1.1 GB
GGUF
DE
HeatSeeker 284B A13B
DeepSeek · UltimateIntent
Params284B
Context1024K
Q4_K_M171.8 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · Krhuz
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
GR
Granite 3.3 2B Instruct BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GR
Granite 4.0 H Tiny BE
Granite · taronaeo
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
QW
AlexWortega Qwen3.8 27B antislop
Qwen · zsulysses
Params27.3B
Context256K
Smallest0.0 GB
GGUF
LI
lingbot map
Lingbot · Asher-1
Params1.16B
Context—
Smallest0.0 GB
GGUF
QW
Qwen Image 2.1 UC
Qwen · klvnyong
Params7.12B
Context—
Smallest14.2 GB
GGUF
QW
Qwen3 235B A22B Thinking 2507 i1
Qwen · mradermacher
Params235B
Context256K
Smallest0.5 GB
GGUF
RE
realistic
Realistic · aufjsufjaujda3
Params11.9B
Context—
Smallest6.9 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · nurdich
Params1.86B
Context256K
Smallest0.9 GB
GGUF
LI
limite 1b violetto GGUF LiteRT
Limite · Tdamre
Params1.07B
Context—
Q4_K_M0.7 GB
GGUF
ST
Cerebras Step 3.5 Flash REAP 149B A11B
Step · wimmmm
Params149B
Context256K
Smallest0.4 GB
GGUF
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · andrijdavid
Params4.43B
Context—
Q4_K_M2.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 UD IQ2XS
DeepSeek · cliecy
Params748B
Context1024K
Smallest0.8 GB
GGUF
QW
Qwen3.8 27B Parasyte
Qwen · cicalooo
Params27.3B
Context256K
Smallest23.0 GB
GGUF
TR
Trinity Large TrueBase i1
Trinity · mradermacher
Params399B
Context8K
Smallest0.5 GB
GGUF
GR
Granite 4.0 3B Vision BE
Granite · taronaeo
Params3.66B
Context128K
Q4_K_M2.2 GB
GGUF
GE
Gemma 4 12b RedTeam BlackICE
Gemma · ChonkE
Params11.9B
Context256K
Smallest0.5 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · JigSawPT
Params755B
Context—
Smallest501.8 GB
GGUF
PI
pix2tex mfr
Pix · cstr
Params29M
Context—
Smallest0.0 GB
GGUF
PH
microsoft phi 4 GGUF IQ2 XXS
Phi · sigmanih
Params14.7B
Context16K
Smallest0.0 GB
GGUF
KR
krea2
Krea · rectangleworm
Params12.8B
Context—
Q4_K_M7.2 GB
GGUF
GR
Granite Vision 4.1 4B BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
ED
edge0 8b a1b
Edge · cipher-000
Params7.89B
Context128K
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731 Pruned 155B A13B
DeepSeek · takanori-ishikawa
Params155B
Context1024K
Smallest1.2 GB
GGUF
LI
voxprint t lite it 2.1
Lite · Mitroshenkov87
Params8.19B
Context40K
Smallest0.0 GB
GGUF

Other uses

Keep browsing