Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.6 35B A3B
Qwen · eaddario
Params34.7B
Context—
Smallest0.4 GB
QW
MiMo V2.6 Distill Qwen 9B
Qwen · VitreousCut
Params9.2B
Context256K
Q4_K_M6.1 GB
SK
sketch
Sketch · calcuis
Params11.9B
Context—
Smallest4.0 GB
TE
Bonsai 2 27B PTQ1 0 MTP Uncensored Ready
Ternary · ayshinko
Params2M
Context—
Smallest0.0 GB
QW
Qwen2.5 Sex
Qwen · ystemsrx
Params1.54B
Context—
Smallest3.1 GB
SA
sam 3d body dinov3
Sam · LocalAI-io
Params841M
Context—
Smallest0.2 GB
QW
voxprint huihui qwen36 27b
Qwen · Mitroshenkov87
Params27.3B
Context—
Smallest0.0 GB
DE
DeepSeek V4.1 Flash 1017
DeepSeek · prometheusAIR
Params748B
Context1024K
Smallest0.8 GB
M2
m2m100 418m
cstr
Params486M
Context—
Smallest0.3 GB
DE
deepseek-ocr2
DeepSeek · cstr
Params3.39B
Context—
Smallest2.3 GB
LC
lcm dreamshaper v7
Lcm · Steward
Params1.07B
Context—
Smallest2.1 GB
KR
Krea2 Muse By Stable Yogi
Krea · ajsbsd
Params12.8B
Context—
Smallest8.3 GB
PO
Pony Realism
Pony · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
SK
SkinTokens GGUF BF16
Skintokens · chibifire
Params29M
Context—
Smallest0.1 GB
DE
DeepSeek V4.1 Flash 1017 Volta
DeepSeek · lxe
Params—
Context—
Smallest441.6 GB
OM
omnigen2
Omnigen · calcuis
Params3.97B
Context—
Q4_K_M6.0 GB
SP
SparkVSR
Sparkvsr · smthem
Params5.57B
Context—
Smallest7.9 GB
CH
Chroma1 HD
Chroma · fairy322
Params8.9B
Context—
Q4_K_M5.6 GB
QW
Qwen3.8 27B
Qwen · eaddario
Params27.3B
Context—
Smallest0.0 GB
QW
Qwen3.8 Flash Next APEX
Qwen · Atomic-Germ
Params177B
Context—
Smallest0.6 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP GGUF Q8 NVFP4
Qwen · AIconjured
Params1.86B
Context—
Smallest0.9 GB
KI
moonshotai Kimi K2.6
Kimi · bartowski
Params1030B
Context256K
Smallest1.5 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · hardcoremoore
Params1.86B
Context—
Smallest0.9 GB
GR
docling
Granite · gguf-org
Params258M
Context—
Q4_K_M0.5 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · LxBarn
Params1.86B
Context256K
Smallest0.9 GB
DE
deepseek v4.1 flash gguf mirror
DeepSeek · hyukudan
Params755B
Context—
Smallest8.0 GB
QW
Swift 1.5 Qwen3.8 27B Badger Mixed
Qwen · CleverBadger
Params27.3B
Context—
Smallest0.0 GB
DE
DeepSeek V4 Flash DSpark draft
DeepSeek · YanissAmz
Params19.8B
Context—
Smallest10.9 GB
QW
Selora AI LLM 14B
Qwen · selorahomes
Params14.8B
Context40K
Smallest0.0 GB
QW
Qwen Image Pruning
Qwen · ThePun1sher
Params12.7B
Context—
Q4_K_M7.8 GB