Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
medgemma 1.5 4b it gguf q5 k m two stage
Medgemma · DocUA
Params3.88B
Context128K
Smallest0.1 GB
GGUF
GE
trails gm gemma4 loras
Gemma · dpetrusevich
Params24M
Context—
Smallest0.0 GB
GGUF
YC
Yclip-B
Yclip · gatilin
Params209M
Context—
Smallest0.8 GB
GGUF
CO
code t5
Code · Jinendra
Params223M
Context—
Smallest0.2 GB
GGUF
QW
Qwen3.6 35B A3B MTP Mixed Q8 0
Qwen · AlexanderKyng
Params35.5B
Context256K
Smallest0.2 GB
GGUF
GE
Gemma 4 31B Styletune GGUF 5.05BPW
Gemma · Beinsezii
Params32.1B
Context256K
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · hardknocks
Params284B
Context1024K
Smallest10.9 GB
GGUF
WA
Wan diffusers
Wan · Gluttony10
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
MO
Moirai-2.0-R-small
Moirai · amaye15
Params11M
Context—
Smallest0.0 GB
GGUF
QW
AKL Qwen3.5-0.8B hybrid
Qwen · neutrino2211
Params800M
Context—
Smallest3.0 GB
GGUF
TR
trocr-base-printed
Trocr · cstr
Params385M
Context—
Smallest0.4 GB
GGUF
LL
Llama 70B God Tier
Llama · Daga2001
Params66M
Context—
Smallest0.1 GB
GGUF
ML
mlx gguf oob poc
Mlx · Orionix03
Params—
Context—
Smallest0.0 GB
GGUF
QW
qwen3 aligner
Qwen · tanweilu
Params918M
Context—
Smallest1.0 GB
GGUF
FA
UltraScopeNet
Falcon · Falconsai
Params—
Context—
Smallest0.0 GB
GGUF
AK
K5
Akanetendo · AkaneTendo25
Params124M
Context—
Smallest0.1 GB
GGUF
MO
modelaudit gguf array chat template poc
Modelaudit · celvexgroup
Params—
Context—
Smallest0.0 GB
GGUF
IM
impact-libero-10
Impact · khanhnd61
Params96M
Context—
Smallest0.4 GB
GGUF
DE
DeepseekV4 Flash 20260731 DSpark
DeepSeek · am17an
Params19.8B
Context1024K
Smallest10.9 GB
GGUF
GE
Gemma 2 2b It
Gemma · Serveurperso
Params21M
Context—
Smallest0.1 GB
GGUF
GE
Gemma 2 2b It
Gemma · CC-TM
Params21M
Context—
Smallest0.1 GB
GGUF
CV
cvector experiments
Cvector · gghfez
Params—
Context—
Smallest0.0 GB
GGUF
YU
YuE2 3B Q8 0 Baked
Yue · LeeAeron
Params677M
Context—
Smallest0.5 GB
GGUF
SE
sensenova u1.5 8b mot
Sensenova · convertor
Params17.5B
Context—
Smallest10.0 GB
GGUF
FO
Fooocus Nex
Fooocus · Old-Fisherman
Params4.76B
Context512
Q4_K_M1.6 GB
GGUF
MI
TIGER PASS 13B MIXTRAL
Mistral · Shrijanagain
Params12.9B
Context—
Q4_K_M7.8 GB
GGUF
LL
LoRA Llama 3 Instruct abliteration 8B F16
Llama · ggml-org
Params88M
Context—
Smallest0.4 GB
GGUF
FA
falcon 7b
Falcon · NikolayKozloff
Params7.22B
Context—
Smallest4.1 GB
GGUF
MI
MiniCPM5 1B NekoQA v2 LoRA
MiniCPM · DennisHuang648
Params11M
Context—
Smallest0.0 GB
GGUF
LI
lightonai/GTE-ModernColBERT-v1
Lightonai · johannhartmann
Params149M
Context—
Smallest0.3 GB
GGUF

Other uses

Keep browsing