Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
UM
Umt5 Xxl Encode Only
Umt · HighDoping
Params5.68B
Context512
Q4_K_M3.7 GB
GGUF
GG
ggml CLIP ViT H 14 laion2B s32B b79K
Ggml · mys
Params986M
Context—
Smallest0.2 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · vultr
Params284B
Context1024K
Smallest10.9 GB
GGUF
CO
comfyui nsfw model pack
Comfyui · VirtuaVixenTube
Params9.08B
Context—
Smallest18.2 GB
GGUF
MA
Marlin-2B
Marlin · jadeonrails
Params2.39B
Context256K
Smallest0.7 GB
GGUF
GL
GLiNER2.5 Decide
Gliner · antflydb
Params434M
Context512
Smallest0.1 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · hsmorikawa
Params748B
Context1024K
Smallest1.6 GB
GGUF
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · qtum
Params284B
Context1024K
Smallest63.1 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · ktobik
Params755B
Context—
Smallest365.7 GB
GGUF
QW
Qwen3.5 4B Uncensored HauhauCS Aggressive MTP
Qwen · Affcccbvdv2333-12
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
OP
opus-mt-de-en
Opus · cstr
Params75M
Context—
Smallest0.1 GB
GGUF
DE
dspark DeepSeek V4 Pro 0813
DeepSeek · pokey2025
Params77.5B
Context1024K
Smallest30.8 GB
GGUF
OR
Ornith 1.5 35B A3B Abliterated 12GB
Ornith · cognitivers
Params34.7B
Context256K
Smallest0.2 GB
GGUF
HO
K2 Horizon 7B
Horizon · eaddario
Params9B
Context512K
Smallest0.0 GB
GGUF
QW
Qwen3.5 0.8B BE
Qwen · taronaeo
Params773M
Context256K
Q4_K_M0.5 GB
GGUF
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · prometheusAIR
Params284B
Context1024K
Smallest0.5 GB
GGUF
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · AshwinX
Params1.68B
Context1024K
Smallest0.6 GB
GGUF
TI
tiny sd
Tiny · turingevo
Params530M
Context—
Smallest0.8 GB
GGUF
QW
remyxai/SpaceQwen2.5-VL-3B-Instruct
Qwen · remyxai
Params3.09B
Context125K
Smallest2.7 GB
GGUF
GR
Granite 4.0 Micro BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
QW
Qwen3.8 Flash Next Uncensored MTP
Qwen · theJuice85
Params56M
Context—
Smallest0.1 GB
GGUF
BI
bidirlm omni 2.5b
Bidirlm · cstr
Params2.45B
Context125K
Smallest0.0 GB
GGUF
BG
bge reranker base
BGE · cstr
Params278M
Context—
Smallest0.3 GB
GGUF
DE
DeepSeek V4 Flash 0731 StrixHalo Verified
DeepSeek · Kevletesteur
Params284B
Context1024K
Smallest103.2 GB
GGUF
GL
GLM 5.3 Flash Heretic Abliterated LoRA V3
GLM · MorinoNushi
Params34M
Context—
Smallest0.1 GB
GGUF
GL
GLM-5.3-Flash
GLM · BioDec
Params321B
Context1024K
Smallest141.7 GB
GGUF
TE
Ternary Bonsai 2 27B Speculative Drafters
Ternary · NOhhh
Params1.92B
Context2K
Smallest0.0 GB
GGUF
QW
Qwen3.8 27B NVFP4 MTP
Qwen · tiyuvta
Params27B
Context—
Smallest0.0 GB
GGUF
TE
Swift Bonsai 2 PQ2 0 MTP Q8 0
Ternary · Bestbug
Params27.3B
Context256K
Smallest7.7 GB
GGUF
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · rax4901
Params284B
Context1024K
Smallest3.8 GB
GGUF

Other uses

Keep browsing