Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LU
Lucy Edit Dev
Lucy · befox
Params5B
Context—
Smallest2.0 GB
GGUF
GL
GLM 4.6V
GLM · ddh0
Params107B
Context128K
Smallest0.2 GB
GGUF
SP
SprongMotion-14M
Sprongmotion · SegerEnd
Params20M
Context—
Smallest0.0 GB
GGUF
ON
plum 1 0.8b
Onejev · canivel
Params752M
Context256K
Smallest0.0 GB
GGUF
LA
laya_multilingual_unsloth_dynamic
Laya · ldov
Params323M
Context—
Q4_K_M0.5 GB
GGUF
SP
splade pp en v1
Splade · cstr
Params110M
Context—
Smallest0.1 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · BambiSunny
Params1M
Context—
Q4_K_M444.7 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 V6d codezh mixed192 IQ2XS
DeepSeek · cliecy
Params477B
Context1024K
Smallest199.2 GB
GGUF
15
153289
123543o1
Params6.15B
Context—
Q4_K_M5.0 GB
GGUF
MI
Candle Hermes Trismegistus Mistral 7B
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
LL
Llama 3 3 Nemotron Super 49B v1 5 fit24gib
Llama · Alberto-Codes
Params49.9B
Context128K
Smallest0.0 GB
GGUF
AN
Anima2.9b
Anima · copilot-pantry
Params2.92B
Context—
Smallest5.8 GB
GGUF
QW
Huihui Qwen AgentWorld 35B A3B abliterated UD Q3 K M
Qwen · coolthor
Params34.7B
Context256K
Smallest0.2 GB
GGUF
DE
DeepSeek V4 Flash imatrix aligned
DeepSeek · jedisct1
Params284B
Context—
Smallest3.8 GB
GGUF
TI
timesfm 3.0
Timesfm · mys
Params331M
Context—
Q4_K_M0.3 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 V1b count288 IQ2XS
DeepSeek · cliecy
Params613B
Context1024K
Smallest239.9 GB
GGUF
SM
SmolDocling-256M-preview
Smoldocling · cstr
Params256M
Context—
Smallest0.2 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 V6e codezh reap176gen16 IQ2XS
DeepSeek · cliecy
Params477B
Context1024K
Smallest199.2 GB
GGUF
MI
Mistral Large 4 1T A52B Uncensored
Mistral · 10exdev
Params114M
Context—
Smallest0.5 GB
GGUF
BI
bionerd re
Biomednlp · joshyalphonse
Params44M
Context—
Smallest0.1 GB
GGUF
HE
Hermes 4 405B i1
Hermes · mradermacher
Params19M
Context—
Smallest0.1 GB
GGUF
YO
YOLO26
Yolo · ayaromenok
Params—
Context—
Smallest0.0 GB
GGUF
ZI
ZIT Checkpoints
Zit · EllaPriest45
Params—
Context—
Smallest6.5 GB
GGUF
IN
Inkling-Small MTP-BF16
Inkling · Baekpica
Params—
Context—
Smallest4.5 GB
GGUF
GE
Gemma4
Gemma · Phil2Sat
Params470M
Context256K
Q4_K_M0.4 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · bartowski
Params284B
Context1024K
Smallest156.0 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · lstari
Params1.86B
Context256K
Smallest0.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 iVQ
DeepSeek · Baekpica
Params485M
Context—
Smallest1.0 GB
GGUF
MI
minimax h3
Minimax · gguf-org
Params151M
Context—
Smallest0.3 GB
GGUF
DE
DeepSeek V4 Flash 0731 NVFP4
DeepSeek · axiomofmind
Params—
Context—
Smallest10.9 GB
GGUF

Other uses

Keep browsing