Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CL
clip text large
Clip · my-app-s
Params124M
Context—
Smallest0.1 GB
GGUF
QW
qwen3 6 27b chinese xianxia lora v2
Qwen · yuxinlu1
Params80M
Context—
Smallest0.2 GB
GGUF
HI
hidream i1 fp8 full dev fast ggufs
Hidream · ND911
Params17.1B
Context—
Smallest11.5 GB
GGUF
MI
Mistral Small 24B Vore Lora
Mistral · Jobobby04
Params46M
Context—
Smallest0.1 GB
GGUF
FC
fca style v33 8step
Fca · Zuntan
Params11.9B
Context—
Smallest6.8 GB
GGUF
WU
wumzi models
Wumzi · kalyanvranjan
Params618M
Context—
Smallest0.7 GB
GGUF
LF
LFM3 1.7B Q8A64
Lfm · VelociQ8
Params1.79B
Context—
Smallest1.8 GB
GGUF
QW
qwen3.8 flash next abliterated lora
Qwen · chenrm
Params18M
Context—
Smallest0.0 GB
GGUF
NE
Nemotron 3 Nano 30B A3B pirola IQ3 XXS
Nemotron · pirola
Params35.4B
Context1024K
Smallest0.1 GB
GGUF
VA
vae
Vae · Nexus24
Params251M
Context—
Smallest0.5 GB
GGUF
IM
x image
Image · gguf-org
Params84M
Context—
Smallest0.2 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · ayourtch
Params755B
Context—
Smallest365.7 GB
GGUF
KA
kairsun 270m
Kairsun · KairSun
Params268M
Context32K
Smallest0.0 GB
GGUF
KI
Kimi-K3
Kimi · HaithamalWaisy
Params7.95B
Context1024K
Smallest5.3 GB
GGUF
SU
surya det
Surya · cstr
Params38M
Context—
Smallest0.0 GB
GGUF
LO
LongCat Image
Longcat · stduhpf
Params6.27B
Context—
Q4_K_M3.7 GB
GGUF
GL
GLM 4.6 Derestricted v3 i1
GLM · mradermacher
Params172M
Context—
Smallest0.7 GB
GGUF
HY
Hy3
tarruda
Params295B
Context256K
Smallest0.6 GB
GGUF
KI
Kimi-K2.7-Code-DFlash-full
Kimi · freakyskittle
Params1.98B
Context—
Smallest1.1 GB
GGUF
MI
MiMo V2.6 Pro RL
Mimo · smalinin
Params764M
Context—
Smallest3.1 GB
GGUF
VA
VAGOsolutions/SauerkrautLM-Multi-ModernColBERT
Vagosolutions · johannhartmann
Params149M
Context—
Smallest0.3 GB
GGUF
MO
Monstral 123B v2
Monstral · MarsupialAI
Params123B
Context—
Smallest10.3 GB
GGUF
DE
DeepSeek V4 Flash 0731 heretic abliterated v2 GGUF lora
DeepSeek · BahamutRU
Params—
Context—
Smallest0.0 GB
GGUF
OM
omnikrea2
Omnikrea · SEVUNX
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · chuzka
Params284B
Context1024K
Smallest10.9 GB
GGUF
QW
Qwen3.8 27B ZeroRefusal UD IQ4 XS MTP
Qwen · Hefen2959512
Params461M
Context—
Smallest0.0 GB
GGUF
OR
orca mini 3B
Orca · juanjgit
Params3.43B
Context—
Smallest1.9 GB
GGUF
QW
Qwen3 8B Houdini VEX v46
Qwen · anshulVashist
Params8.19B
Context40K
Smallest0.3 GB
GGUF
MI
Candle lvkaokao mistral 7b finetuned orca dpo v2
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
TE
TernaryPilot v2 Computer Browser Use LoRA
Ternary · adriandj3
Params160M
Context—
Smallest0.3 GB
GGUF

Other uses

Keep browsing