Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwopus3.6 35B A3B Coder MXFP4 MOE Hybrid Imatrix
Qwopus · jashepp
Params34.7B
Context256K
Smallest0.2 GB
GGUF
MI
Candle Mistral Pro 8B v0.1
Mistral · DanielClough
Params8.99B
Context—
Smallest2.9 GB
GGUF
EQ
Equinox 31B i1 MXFP4
Equinox · jashepp
Params30.7B
Context256K
Smallest0.0 GB
GGUF
CA
Candle Phi Hermes 1.3B
Candle · DanielClough
Params1.41B
Context—
Smallest0.5 GB
GGUF
CO
comfy
Comfy · SimonJoz
Params11.9B
Context—
Smallest12.7 GB
GGUF
NO
nomic embed text v2 moe
Nomic · cstr
Params475M
Context—
Smallest0.4 GB
GGUF
MI
MiMo V2.6 Flash MXFP4
Mimo · kernelpool
Params310B
Context1024K
Smallest0.8 GB
GGUF
QW
Qwen3.5 35B A3B IQ3 S custom mix
Qwen · Kevletesteur
Params34.7B
Context256K
Smallest15.8 GB
GGUF
LI
ActQuant Pi05 LIBERO 3bpw
Libero · NU-World-Model-Embodied-AI
Params3.39B
Context—
Smallest2.4 GB
GGUF
AR
Ark Cortex v3 8B Ternary
Ark · Ooriginador
Params8.19B
Context256K
Smallest4.5 GB
GGUF
QW
Qwen3.8 27B
Qwen · jakeatx
Params27.3B
Context256K
Smallest0.0 GB
GGUF
HU
hyimg3 q2
Hunyuanimage · convertor
Params82.5B
Context—
Smallest31.5 GB
GGUF
KR
Krea2 Muse By Stable Yogi
Krea · chfm
Params12.8B
Context—
Smallest8.3 GB
GGUF
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · Mattobik
Params1.68B
Context1024K
Smallest0.6 GB
GGUF
QW
Qwen3.5 397B A17B
Qwen · ubergarm
Params396B
Context256K
Smallest1.1 GB
GGUF
WA
wanautoinstall
Wanautoinstall · johnjohn200
Params17.3B
Context—
Smallest10.6 GB
GGUF
QW
Qwen3.5-9B
Qwen · openmodelai
Params456M
Context—
Smallest0.9 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · jchonde
Params1.86B
Context256K
Smallest0.9 GB
GGUF
MO
moshika q4 k
Moshika · Codes4Fun
Params7.69B
Context—
Smallest4.3 GB
GGUF
BI
biglove
Biglove · napalm
Params9.08B
Context—
Smallest6.5 GB
GGUF
ZI
ZIT
Zit · ajsbsd
Params6.15B
Context—
Smallest6.5 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Whytime
Params1.86B
Context256K
Smallest0.9 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · vanchi34200
Params1.86B
Context256K
Smallest0.9 GB
GGUF
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · tarruda
Params284B
Context1024K
Smallest0.5 GB
GGUF
SA
Samantha big MoE i1
Samantha · mradermacher
Params108B
Context10240K
Smallest0.1 GB
GGUF
MO
modernbooknlp
Modernbooknlp · zloezlo
Params111M
Context—
Smallest0.2 GB
GGUF
MI
openbmb/MiniCPM-OCR-1.0
MiniCPM · cstr
Params1.3B
Context—
Smallest1.0 GB
GGUF
TE
sd1.5 text2img
Text · Sashkanik13
Params1.07B
Context—
Smallest1.6 GB
GGUF
DE
PAW 763B X3
DeepSeek · lackonendes
Params1.13B
Context—
Smallest0.7 GB
GGUF
MI
minicpm5 2b rco
MiniCPM · efeisot
Params2.52B
Context128K
Smallest0.0 GB
GGUF

Other uses

Keep browsing