Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
ER
ERNIE Image Turbo
Ernie · Solictous
Params8.03B
Context—
Smallest5.1 GB
GGUF
BE
bekko embedding v1 a25m Q8A64
Bekko · VelociQ8
Params237M
Context8K
Smallest0.2 GB
GGUF
GR
GRM 3.2 Sky
Grm · thread13
Params35.5B
Context256K
Smallest12.7 GB
GGUF
JI
jina embeddings v5 text nano retrieval Q8A64
Jina · VelociQ8
Params322M
Context8K
Smallest0.3 GB
GGUF
JE
jepa cpp umaze parity
Jepa · agentic-learning-ai-lab
Params25M
Context—
Smallest0.1 GB
GGUF
MI
Mistral Small 4 119B 2603
Mistral · AesSedai
Params119B
Context1024K
Smallest0.1 GB
GGUF
ST
Step 3.7 Flash GGUF FineTune
Step · ashuaria
Params197B
Context256K
Smallest0.5 GB
GGUF
BE
bekko embedding v1 a8m Q8A64
Bekko · VelociQ8
Params219M
Context8K
Smallest0.2 GB
GGUF
GR
Groot 238B A18B 261023 i1
Groot · mradermacher
Params243B
Context1024K
Smallest0.8 GB
GGUF
MI
Candle MistralLite
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
GO
Goetia 26B A4B v1.4 LazyLora heresy I Compact MXFP4
Goetia · Phil2Sat
Params25.2B
Context256K
Smallest0.1 GB
GGUF
HA
harrier oss v1 270m Q8A64
Harrier · VelociQ8
Params283M
Context32K
Smallest0.3 GB
GGUF
PA
Pantheon Reasoning 26B A4B 1.1 MXFP4 MOE Hybrid Imatrix
Pantheon · jashepp
Params26B
Context256K
Smallest0.1 GB
GGUF
LA
laya
Laya · zerodegress
Params421M
Context—
Smallest0.8 GB
GGUF
SE
serenity26ba4b requant
Serenity · sca255
Params25.2B
Context256K
Smallest0.1 GB
GGUF
RI
Rio 3.1 Open 235B VL i1
Rio · mradermacher
Params235B
Context256K
Smallest0.5 GB
GGUF
CL
Clef Flash
Clef · cuongpp
Params9.08B
Context256K
Smallest0.9 GB
GGUF
RO
routeframe models
Routeframe · kunal732
Params48M
Context—
Smallest0.0 GB
GGUF
GR
granite embedding 311m multilingual r2
Granite · cstr
Params323M
Context—
Smallest0.3 GB
GGUF
OC
Octen Embedding 0.6B Q8A64
Octen · VelociQ8
Params621M
Context32K
Smallest0.6 GB
GGUF
DE
DeepSeek V4 Flash Vision Exp MXFP4
DeepSeek · QuantaPlanta
Params284B
Context1024K
Smallest10.9 GB
GGUF
QW
Qwen3.8 27B padthai
Qwen · mcham
Params27.3B
Context256K
Smallest0.0 GB
GGUF
TW
TwinFlow Z Image Turbo diffuser
Twinflow · smthem
Params6.16B
Context—
Smallest5.0 GB
GGUF
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · terelabs
Params7.52B
Context64K
Smallest0.0 GB
GGUF
FI
FireRed Image Edit 1.0
Firered · Frederic75
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
FE
fesby
Fesby · sdcairos
Params6.15B
Context—
Smallest7.2 GB
GGUF
QW
Orca Qwen3.8 27B Uncensored unsloth mlx
Qwen · nova-quill
Params3M
Context—
Smallest0.0 GB
GGUF
QW
Qwopus3.8 27B Flash ATX IQ4 XS M
Qwopus · jakeatx
Params27.3B
Context256K
Smallest0.0 GB
GGUF
T5
t5 v1 1 xl encoder
chatpig
Params1.22B
Context—
Q4_K_M0.7 GB
GGUF
PI
PIXIE Rune v1.0 Q8A64
Pixie · VelociQ8
Params865M
Context8K
Smallest0.9 GB
GGUF

Other uses

Keep browsing