Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek V4 Flash MTP support
DeepSeek · eadx
Params284B
Context1024K
Smallest3.8 GB
BO
Bonsai 1.7B requantized
Bonsai · cuio
Params1.72B
Context32K
Smallest0.0 GB
AI
Aikimi
Aikimi · 75dhsx
Params11.9B
Context—
Smallest12.7 GB
QW
aura qwen35 2b korean multisession memory extract lora
Qwen · mangoo3431
Params11M
Context—
Smallest0.0 GB
SI
Silero VAD
Silero · empyrealworks
Params—
Context—
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731 Ombro v3c
DeepSeek · Wladastic
Params284B
Context1024K
Smallest85.8 GB
LL
llama3 8b ecom copywriter lora
Llama · tarkovski
Params42M
Context—
Smallest0.2 GB
QW
qwen3 0.6b base loom
Qwen · loom-ai-org
Params596M
Context—
Smallest2.4 GB
WI
Winery Strata
Winery · WineryLabs
Params—
Context—
Smallest0.0 GB
HI
HiggsTTS3
Higgstts · liampetti
Params4.65B
Context—
Smallest2.8 GB
QW
pure fin sniper
Qwen · airfoilia1
Params40M
Context—
Smallest0.2 GB
BO
sakura vl
Bonsai · VatsaDev
Params1.72B
Context256K
Smallest0.2 GB
GE
gemma 4 31b it qcache q4k
Gemma · DeepDavid
Params30.7B
Context—
Smallest17.3 GB
SM
smolvla so101 fp16
Smolvla · robotcpp
Params100M
Context—
Smallest0.0 GB
BA
Barcenas 7b
Barcenas · Danielbrdz
Params6.74B
Context4K
Smallest4.7 GB
MU
multi format vulnerability poc
Multi · Asael2899
Params—
Context—
Smallest0.0 GB
LL
Llama 3.2 1B be
Llama · VyoJ
Params1.24B
Context128K
Q4_K_M0.8 GB
ZO
Zorix Nano 2B
Zorix · Zorix-official
Params1.88B
Context256K
Smallest1.4 GB
HY
Hy3 295B A21B PrismaQuant 2.8bit gguf vllm
rdtand
Params295B
Context—
Smallest103.7 GB
DI
dinov2 giant
Dinov · dinov2-cpp-core
Params1.14B
Context—
Smallest2.3 GB
AC
act so101
Act · ravediamond
Params34M
Context—
Smallest0.1 GB
OC
PP-OCRv6_tiny_det
Ocrv · mlx-community
Params—
Context—
Smallest0.0 GB
QW
qwen3.8 27B pi svd lora
Qwen · hotdogs
Params435M
Context—
Smallest1.7 GB
CH
chroma1 radiance x16 calibrated
Chroma · wertz6969
Params9.51B
Context—
Smallest7.1 GB
MY
mytho weaver
Mytho · craigmadd
Params13B
Context4K
Smallest0.1 GB
NS
NSFW master x08 8step
Nsfw · Zuntan
Params11.9B
Context—
Smallest6.8 GB
DA
DaVinci MagiHuman fp8 merges
Davinci · realrebelai
Params9.24B
Context—
Smallest11.9 GB
OC
PP-OCRv6_tiny_det
Ocrv · cstr
Params—
Context—
Smallest0.0 GB
TI
tinystories 15m
Tinyllamas · Arkavo
Params24M
Context128
Smallest0.1 GB
WA
wavlm base plus
Wavlm · mmnga-o
Params24M
Context—
Smallest0.1 GB