Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek V4 Flash 0731 UD IQ3 IQ2 XS
DeepSeek · Oxidez
Params284B
Context1024K
Smallest93.0 GB
OV
h2ovl 800m crispembed
Ovl · cstr
Params826M
Context—
Smallest0.7 GB
GE
Gemma 3N E4B Gutenberg v3
Gemma · jir88
Params38M
Context—
Smallest0.2 GB
TU
tulpar limarp l2 7b
Tulpar · zarakiquemparte
Params6.74B
Context—
Smallest4.8 GB
SU
thuml/sundial-base-128m
Sundial · amaye15
Params128M
Context—
Smallest0.1 GB
QW
qwen3.8 27B pplx decider svd lora
Qwen · hotdogs
Params435M
Context—
Smallest1.7 GB
SI
sinatra
Sinatra · 75dhsx8
Params11.9B
Context—
Smallest5.4 GB
GR
Granite 4.1 8B Power
Granite · librepowerai
Params8.79B
Context128K
Q4_K_M5.3 GB
EX
experimental ggufs
Experimental · furusu
Params11.9B
Context—
Smallest1.5 GB
PA
papersummary 1.5b lora
Papersummary · Probees1492
Params37M
Context—
Smallest0.1 GB
QW
Violet Qwen3.5 2B Ep3
Qwen · silvjayr
Params11M
Context—
Smallest0.0 GB
YI
yiffInHell yihVANTABLACK
Yiffinhell · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
IN
IndexTTS2.5
Indextts · NeemaShioSe
Params1.67B
Context—
Smallest2.0 GB
BA
LS2.5 108M A17M Coder
Base · Dsg2
Params59M
Context—
Q4_K_M0.1 GB
MI
MiniMax H3 Remix Quantized
Minimax · Radha7
Params33.1B
Context—
Smallest32.7 GB
QW
Qwen3.6 27B NVFP4 MXFP6 MTP
Qwen · michaelw9999
Params27.3B
Context256K
Smallest16.4 GB
QW
Qwen3.6 27B 5.10BPW
Qwen · Beinsezii
Params26.9B
Context256K
Smallest0.0 GB
LF
X YEMEN HACK AI V1
Lfm · amarsadan
Params1M
Context—
Smallest0.0 GB
DE
DeepSeek V4 Flash REAP 80G imatrix 0731
DeepSeek · jabbatheduck
Params180B
Context1024K
Smallest70.9 GB
LI
pi0 libero finetuned v044
Libero · fai-modelopt-tech
Params2.82B
Context—
Smallest5.7 GB
GI
GigaChat3.1 702B A36B bf16 i1
Gigachat · mradermacher
Params262M
Context—
Smallest1.0 GB
KR
Krea2 checkpoints2
Krea · gacekmg
Params—
Context—
Smallest14.6 GB
OR
Ornith 1.0 35B MTP Uncensored
Ornith · haign
Params447M
Context256K
Smallest37.8 GB
BO
Shiba Coder 27B Max
Bonsai · Gmartinezr
Params159M
Context—
Smallest0.3 GB
OC
PP-OCRv6_small_det
Ocrv · mlx-community
Params2M
Context—
Smallest0.0 GB
QW
qwen3.8 27B clef svd lora
Qwen · hotdogs
Params163M
Context—
Smallest0.7 GB
TE
my test model8
Test · AX1Y2JP
Params11.9B
Context—
Smallest12.7 GB
QW
qwen3 5 9b philosophy Hegel Lacan Zizek
Qwen · mahahahug
Params58M
Context—
Smallest0.1 GB
YI
yiffInHell yihXXXTended
Yiffinhell · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
CO
Cogidonia 24B Lora
Cogidonia · Gravelrat
Params92M
Context—
Smallest0.2 GB