Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
ME
medgemma 1.5 4b it gguf q5 k m two stage
Medgemma · DocUA
Params3.88B
Context128K
Smallest0.1 GB
GE
trails gm gemma4 loras
Gemma · dpetrusevich
Params24M
Context—
Smallest0.0 GB
YC
Yclip-B
Yclip · gatilin
Params209M
Context—
Smallest0.8 GB
CO
code t5
Code · Jinendra
Params223M
Context—
Smallest0.2 GB
QW
Qwen3.6 35B A3B MTP Mixed Q8 0
Qwen · AlexanderKyng
Params35.5B
Context256K
Smallest0.2 GB
GE
Gemma 4 31B Styletune GGUF 5.05BPW
Gemma · Beinsezii
Params32.1B
Context256K
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · hardknocks
Params284B
Context1024K
Smallest10.9 GB
WA
Wan diffusers
Wan · Gluttony10
Params14.3B
Context—
Q4_K_M9.7 GB
MO
Moirai-2.0-R-small
Moirai · amaye15
Params11M
Context—
Smallest0.0 GB
QW
AKL Qwen3.5-0.8B hybrid
Qwen · neutrino2211
Params800M
Context—
Smallest3.0 GB
TR
trocr-base-printed
Trocr · cstr
Params385M
Context—
Smallest0.4 GB
LL
Llama 70B God Tier
Llama · Daga2001
Params66M
Context—
Smallest0.1 GB
ML
mlx gguf oob poc
Mlx · Orionix03
Params—
Context—
Smallest0.0 GB
QW
qwen3 aligner
Qwen · tanweilu
Params918M
Context—
Smallest1.0 GB
FA
UltraScopeNet
Falcon · Falconsai
Params—
Context—
Smallest0.0 GB
AK
K5
Akanetendo · AkaneTendo25
Params124M
Context—
Smallest0.1 GB
MO
modelaudit gguf array chat template poc
Modelaudit · celvexgroup
Params—
Context—
Smallest0.0 GB
IM
impact-libero-10
Impact · khanhnd61
Params96M
Context—
Smallest0.4 GB
DE
DeepseekV4 Flash 20260731 DSpark
DeepSeek · am17an
Params19.8B
Context1024K
Smallest10.9 GB
GE
Gemma 2 2b It
Gemma · Serveurperso
Params21M
Context—
Smallest0.1 GB
GE
Gemma 2 2b It
Gemma · CC-TM
Params21M
Context—
Smallest0.1 GB
CV
cvector experiments
Cvector · gghfez
Params—
Context—
Smallest0.0 GB
YU
YuE2 3B Q8 0 Baked
Yue · LeeAeron
Params677M
Context—
Smallest0.5 GB
SE
sensenova u1.5 8b mot
Sensenova · convertor
Params17.5B
Context—
Smallest10.0 GB
FO
Fooocus Nex
Fooocus · Old-Fisherman
Params4.76B
Context512
Q4_K_M1.6 GB
MI
TIGER PASS 13B MIXTRAL
Mistral · Shrijanagain
Params12.9B
Context—
Q4_K_M7.8 GB
LL
LoRA Llama 3 Instruct abliteration 8B F16
Llama · ggml-org
Params88M
Context—
Smallest0.4 GB
FA
falcon 7b
Falcon · NikolayKozloff
Params7.22B
Context—
Smallest4.1 GB
MI
MiniCPM5 1B NekoQA v2 LoRA
MiniCPM · DennisHuang648
Params11M
Context—
Smallest0.0 GB
LI
lightonai/GTE-ModernColBERT-v1
Lightonai · johannhartmann
Params149M
Context—
Smallest0.3 GB