Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
cowboy
Qwen · QuillBytes
Params334M
Context—
Smallest0.7 GB
DE
DeepSeek V4 Flash MTP support
DeepSeek · opensota
Params284B
Context1024K
Smallest3.8 GB
CA
candle stablelm
Candle · lmz
Params1.64B
Context—
Smallest0.9 GB
RM
RMBG 2.0_briaai
Rmbg · gobeldan
Params220M
Context—
Smallest0.4 GB
BO
Boogu Image Edit GGUFs
Boogu · chfm
Params10.3B
Context—
Smallest6.8 GB
QW
Hemmingway 1 27B qwen3.8 27B svd lora
Qwen · hotdogs
Params459M
Context—
Smallest0.9 GB
YU
YuE2 audio tokenizer, the v9 head of Mothersuperior, on MERT-v2-FullSong
Yue · JackKnifeAI
Params632M
Context—
Smallest0.0 GB
UN
unet
Unet · bjooo
Params16.4B
Context—
Smallest15.4 GB
QW
Qwen2-VL-2B-Instruct
Qwen · sidrajaram
Params1.54B
Context32K
Smallest2.7 GB
NE
Nemotron 3.5 Bolt GameDev
Nemotron · ahpah
Params7.52B
Context64K
Smallest0.0 GB
DE
DeepSeek V4.1 Flash
DeepSeek · Sleepy303
Params755B
Context—
Smallest365.7 GB
TU
turbovla libero
Turbovla · vrfai
Params215M
Context—
Smallest0.9 GB
AY
ayoub
Ayoub · Khepridung
Params11.9B
Context—
Smallest6.8 GB
ST
stt 1b en fr
Stt · Codes4Fun
Params989M
Context—
Smallest2.0 GB
YU
yue2 3b
Yue · gguf-org
Params3.77B
Context—
Smallest2.3 GB
UN
UNET
Unet · f5aiteam
Params11.9B
Context—
Smallest6.8 GB
SU
surfer
Surfer · QuillBytes
Params334M
Context—
Smallest0.7 GB
MI
Voxtral Mini 4B Realtime 2602 CrispASR
Mistral · adriabama06
Params4.43B
Context—
Smallest2.5 GB
TR
TrOCR Math Handwritten (AFL-3.0)
Trocr · cstr
Params609M
Context—
Smallest0.4 GB
QW
Lattice 1 107M Poincare Preview
Qwen · DuoNeural
Params107M
Context512
Q4_K_M0.1 GB
SM
Sub Lattice 17M Poincare Instruct
SmolLM · DuoNeural
Params17M
Context512
Q4_K_M0.0 GB
SM
Lattice 4 Josephson 253M Poincare Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
HE
Hemmingway 1 Unlocked
Hemmingway · newsletter
Params934M
Context—
Smallest1.9 GB
LI
lilt funsd
Lilt · cstr
Params130M
Context—
Smallest0.1 GB
OR
Ornith 1.0 9B Hf
Ornith · sxlvia
Params8.95B
Context256K
Q4_K_M11.8 GB
TE
ternary bonsai 2 27b decision lora
Ternary · ChezRD
Params934M
Context—
Smallest0.5 GB
MY
MythP0rt 8step
Mythp · Zuntan
Params11.9B
Context—
Smallest6.8 GB
PR
project0 real1smV3FP16 quants
Project · marduk191
Params11.9B
Context—
Smallest4.0 GB
GL
Huihui GLM 4.5 Air abliterated lossytensors i1
GLM · mradermacher
Params110B
Context128K
Smallest0.2 GB
DE
deepseek ai.DeepSeek V4 Pro
DeepSeek · DevQuasar
Params1570B
Context1024K
Q4_K_M950.9 GB