Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash MTP support
DeepSeek · eadx
Params284B
Context1024K
Smallest3.8 GB
GGUF
BO
Bonsai 1.7B requantized
Bonsai · cuio
Params1.72B
Context32K
Smallest0.0 GB
GGUF
AI
Aikimi
Aikimi · 75dhsx
Params11.9B
Context—
Smallest12.7 GB
GGUF
QW
aura qwen35 2b korean multisession memory extract lora
Qwen · mangoo3431
Params11M
Context—
Smallest0.0 GB
GGUF
SI
Silero VAD
Silero · empyrealworks
Params—
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731 Ombro v3c
DeepSeek · Wladastic
Params284B
Context1024K
Smallest85.8 GB
GGUF
LL
llama3 8b ecom copywriter lora
Llama · tarkovski
Params42M
Context—
Smallest0.2 GB
GGUF
QW
qwen3 0.6b base loom
Qwen · loom-ai-org
Params596M
Context—
Smallest2.4 GB
GGUF
WI
Winery Strata
Winery · WineryLabs
Params—
Context—
Smallest0.0 GB
GGUF
HI
HiggsTTS3
Higgstts · liampetti
Params4.65B
Context—
Smallest2.8 GB
GGUF
QW
pure fin sniper
Qwen · airfoilia1
Params40M
Context—
Smallest0.2 GB
GGUF
BO
sakura vl
Bonsai · VatsaDev
Params1.72B
Context256K
Smallest0.2 GB
GGUF
GE
gemma 4 31b it qcache q4k
Gemma · DeepDavid
Params30.7B
Context—
Smallest17.3 GB
GGUF
SM
smolvla so101 fp16
Smolvla · robotcpp
Params100M
Context—
Smallest0.0 GB
GGUF
BA
Barcenas 7b
Barcenas · Danielbrdz
Params6.74B
Context4K
Smallest4.7 GB
GGUF
MU
multi format vulnerability poc
Multi · Asael2899
Params—
Context—
Smallest0.0 GB
GGUF
LL
Llama 3.2 1B be
Llama · VyoJ
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
ZO
Zorix Nano 2B
Zorix · Zorix-official
Params1.88B
Context256K
Smallest1.4 GB
GGUF
HY
Hy3 295B A21B PrismaQuant 2.8bit gguf vllm
rdtand
Params295B
Context—
Smallest103.7 GB
GGUF
DI
dinov2 giant
Dinov · dinov2-cpp-core
Params1.14B
Context—
Smallest2.3 GB
GGUF
AC
act so101
Act · ravediamond
Params34M
Context—
Smallest0.1 GB
GGUF
OC
PP-OCRv6_tiny_det
Ocrv · mlx-community
Params—
Context—
Smallest0.0 GB
GGUF
QW
qwen3.8 27B pi svd lora
Qwen · hotdogs
Params435M
Context—
Smallest1.7 GB
GGUF
CH
chroma1 radiance x16 calibrated
Chroma · wertz6969
Params9.51B
Context—
Smallest7.1 GB
GGUF
MY
mytho weaver
Mytho · craigmadd
Params13B
Context4K
Smallest0.1 GB
GGUF
NS
NSFW master x08 8step
Nsfw · Zuntan
Params11.9B
Context—
Smallest6.8 GB
GGUF
DA
DaVinci MagiHuman fp8 merges
Davinci · realrebelai
Params9.24B
Context—
Smallest11.9 GB
GGUF
OC
PP-OCRv6_tiny_det
Ocrv · cstr
Params—
Context—
Smallest0.0 GB
GGUF
TI
tinystories 15m
Tinyllamas · Arkavo
Params24M
Context128
Smallest0.1 GB
GGUF
WA
wavlm base plus
Wavlm · mmnga-o
Params24M
Context—
Smallest0.1 GB
GGUF

Other uses

Keep browsing