Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
cowboy
Qwen · QuillBytes
Params334M
Context—
Smallest0.7 GB
GGUF
DE
DeepSeek V4 Flash MTP support
DeepSeek · opensota
Params284B
Context1024K
Smallest3.8 GB
GGUF
CA
candle stablelm
Candle · lmz
Params1.64B
Context—
Smallest0.9 GB
GGUF
RM
RMBG 2.0_briaai
Rmbg · gobeldan
Params220M
Context—
Smallest0.4 GB
GGUF
BO
Boogu Image Edit GGUFs
Boogu · chfm
Params10.3B
Context—
Smallest6.8 GB
GGUF
QW
Hemmingway 1 27B qwen3.8 27B svd lora
Qwen · hotdogs
Params459M
Context—
Smallest0.9 GB
GGUF
YU
YuE2 audio tokenizer, the v9 head of Mothersuperior, on MERT-v2-FullSong
Yue · JackKnifeAI
Params632M
Context—
Smallest0.0 GB
GGUF
UN
unet
Unet · bjooo
Params16.4B
Context—
Smallest15.4 GB
GGUF
QW
Qwen2-VL-2B-Instruct
Qwen · sidrajaram
Params1.54B
Context32K
Smallest2.7 GB
GGUF
NE
Nemotron 3.5 Bolt GameDev
Nemotron · ahpah
Params7.52B
Context64K
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · Sleepy303
Params755B
Context—
Smallest365.7 GB
GGUF
TU
turbovla libero
Turbovla · vrfai
Params215M
Context—
Smallest0.9 GB
GGUF
AY
ayoub
Ayoub · Khepridung
Params11.9B
Context—
Smallest6.8 GB
GGUF
ST
stt 1b en fr
Stt · Codes4Fun
Params989M
Context—
Smallest2.0 GB
GGUF
YU
yue2 3b
Yue · gguf-org
Params3.77B
Context—
Smallest2.3 GB
GGUF
UN
UNET
Unet · f5aiteam
Params11.9B
Context—
Smallest6.8 GB
GGUF
SU
surfer
Surfer · QuillBytes
Params334M
Context—
Smallest0.7 GB
GGUF
MI
Voxtral Mini 4B Realtime 2602 CrispASR
Mistral · adriabama06
Params4.43B
Context—
Smallest2.5 GB
GGUF
TR
TrOCR Math Handwritten (AFL-3.0)
Trocr · cstr
Params609M
Context—
Smallest0.4 GB
GGUF
QW
Lattice 1 107M Poincare Preview
Qwen · DuoNeural
Params107M
Context512
Q4_K_M0.1 GB
GGUF
SM
Sub Lattice 17M Poincare Instruct
SmolLM · DuoNeural
Params17M
Context512
Q4_K_M0.0 GB
GGUF
SM
Lattice 4 Josephson 253M Poincare Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
GGUF
HE
Hemmingway 1 Unlocked
Hemmingway · newsletter
Params934M
Context—
Smallest1.9 GB
GGUF
LI
lilt funsd
Lilt · cstr
Params130M
Context—
Smallest0.1 GB
GGUF
OR
Ornith 1.0 9B Hf
Ornith · sxlvia
Params8.95B
Context256K
Q4_K_M11.8 GB
GGUF
TE
ternary bonsai 2 27b decision lora
Ternary · ChezRD
Params934M
Context—
Smallest0.5 GB
GGUF
MY
MythP0rt 8step
Mythp · Zuntan
Params11.9B
Context—
Smallest6.8 GB
GGUF
PR
project0 real1smV3FP16 quants
Project · marduk191
Params11.9B
Context—
Smallest4.0 GB
GGUF
GL
Huihui GLM 4.5 Air abliterated lossytensors i1
GLM · mradermacher
Params110B
Context128K
Smallest0.2 GB
GGUF
DE
deepseek ai.DeepSeek V4 Pro
DeepSeek · DevQuasar
Params1570B
Context1024K
Q4_K_M950.9 GB
GGUF

Other uses

Keep browsing