Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
WA
WAN saves
Wan · justabigduck
Params14.3B
Context—
Smallest9.7 GB
GGUF
QW
Qwen Image Edit Pruning
Qwen · befox
Params13.6B
Context—
Smallest5.0 GB
GGUF
GP
gpt oss 120b mandarin thinking i1
gpt-oss · mradermacher
Params40M
Context—
Smallest0.2 GB
GGUF
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · 55555EE
Params284B
Context1024K
Smallest3.8 GB
GGUF
CO
contriever
Contriever · masahiroid
Params109M
Context—
Smallest0.4 GB
GGUF
TE
Tempting Krea 2 NSFW
Tempting · ModdiAdam
Params12.8B
Context—
Q4_K_M8.3 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · buddalaw
Params755B
Context—
Smallest365.7 GB
GGUF
LL
MiMo V2.5 Pro
Llama · gghfez
Params1020B
Context1024K
Smallest274.1 GB
GGUF
AW
AWPortrait FL
Awportrait · SporkySporkness
Params11.9B
Context—
Smallest4.0 GB
GGUF
PA
paddleocr vl 1.6
Paddleocr · cstr
Params943M
Context—
Smallest1.3 GB
GGUF
UN
unimate_uniml3d_f60_v3
Unimate · Goddard
Params110M
Context—
Smallest0.3 GB
GGUF
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Q4_K_M258.1 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · Nil626yhh
Params284B
Context1024K
Smallest10.9 GB
GGUF
SI
siglip2-so400m-patch16-naflex
Siglip · dbrains
Params1.14B
Context—
Q4_K_M0.8 GB
GGUF
QW
Qwen3.5 397B A17B
Qwen · tarruda
Params396B
Context256K
Smallest1.1 GB
GGUF
ET
ettin reranker 1b v1
Ettin · cstr
Params1.03B
Context—
Smallest0.6 GB
GGUF
HU
humblemikey
Humblemikey · 75dhsx
Params11.9B
Context—
Smallest6.9 GB
GGUF
AL
all MiniLM L12 v2
All · cstr
Params33M
Context—
Smallest0.0 GB
GGUF
RE
RealVisXL V5.0 Lightning
Realvisxl · Solictous
Params3.47B
Context—
Smallest5.0 GB
GGUF
QW
Qwen3.8-27B
Qwen · Valexiem
Params24.2B
Context256K
Smallest5.6 GB
GGUF
AV
averon1.1
Averon · bikesa
Params35.5B
Context256K
Smallest0.9 GB
GGUF
GE
Gemma 4 Queen 31B it uncensored heretic lora
Gemma · SaturnHeaven
Params29M
Context—
Smallest0.0 GB
GGUF
MI
Mistral Large 3 675B Base 2512 i1
Mistral · mradermacher
Params673B
Context288K
Smallest0.6 GB
GGUF
CA
Candle SOLAR 10.7B Instruct v1.0
Candle · DanielClough
Params10.7B
Context—
Smallest3.5 GB
GGUF
TE
TetraNigga DUO 1M
Tetranigga · tetranigga
Params1M
Context—
Smallest0.0 GB
GGUF
LF
lfm3 1.7b arabic lora
Lfm · vladadu
Params32M
Context—
Smallest0.1 GB
GGUF
MD
mdeberta-v3-base
Mdeberta · masahiroid
Params278M
Context—
Smallest1.1 GB
GGUF
GE
GemPT 26B A4B
Gempt · Entity-27th
Params25.2B
Context256K
Smallest0.6 GB
GGUF
GL
GLM 4.5 Iceblink 106B A12B i1
GLM · mradermacher
Params110B
Context128K
Smallest0.2 GB
GGUF
SA
SauerkrautLM MoEdernColBERT 27M
Sauerkrautlm · VAGOsolutions
Params27M
Context—
Smallest0.0 GB
GGUF

Other uses

Keep browsing