Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
UM
Umt5 Xxl Encode Only
Umt · HighDoping
Params5.68B
Context512
Q4_K_M3.7 GB
GG
ggml CLIP ViT H 14 laion2B s32B b79K
Ggml · mys
Params986M
Context—
Smallest0.2 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · vultr
Params284B
Context1024K
Smallest10.9 GB
CO
comfyui nsfw model pack
Comfyui · VirtuaVixenTube
Params9.08B
Context—
Smallest18.2 GB
MA
Marlin-2B
Marlin · jadeonrails
Params2.39B
Context256K
Smallest0.7 GB
GL
GLiNER2.5 Decide
Gliner · antflydb
Params434M
Context512
Smallest0.1 GB
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · hsmorikawa
Params748B
Context1024K
Smallest1.6 GB
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · qtum
Params284B
Context1024K
Smallest63.1 GB
DE
DeepSeek V4.1 Flash
DeepSeek · ktobik
Params755B
Context—
Smallest365.7 GB
QW
Qwen3.5 4B Uncensored HauhauCS Aggressive MTP
Qwen · Affcccbvdv2333-12
Params4.21B
Context256K
Q4_K_M2.7 GB
OP
opus-mt-de-en
Opus · cstr
Params75M
Context—
Smallest0.1 GB
DE
dspark DeepSeek V4 Pro 0813
DeepSeek · pokey2025
Params77.5B
Context1024K
Smallest30.8 GB
OR
Ornith 1.5 35B A3B Abliterated 12GB
Ornith · cognitivers
Params34.7B
Context256K
Smallest0.2 GB
HO
K2 Horizon 7B
Horizon · eaddario
Params9B
Context512K
Smallest0.0 GB
QW
Qwen3.5 0.8B BE
Qwen · taronaeo
Params773M
Context256K
Q4_K_M0.5 GB
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · prometheusAIR
Params284B
Context1024K
Smallest0.5 GB
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · AshwinX
Params1.68B
Context1024K
Smallest0.6 GB
TI
tiny sd
Tiny · turingevo
Params530M
Context—
Smallest0.8 GB
QW
remyxai/SpaceQwen2.5-VL-3B-Instruct
Qwen · remyxai
Params3.09B
Context125K
Smallest2.7 GB
GR
Granite 4.0 Micro BE
Granite · taronaeo
Params3.4B
Context128K
Q4_K_M2.1 GB
QW
Qwen3.8 Flash Next Uncensored MTP
Qwen · theJuice85
Params56M
Context—
Smallest0.1 GB
BI
bidirlm omni 2.5b
Bidirlm · cstr
Params2.45B
Context125K
Smallest0.0 GB
BG
bge reranker base
BGE · cstr
Params278M
Context—
Smallest0.3 GB
DE
DeepSeek V4 Flash 0731 StrixHalo Verified
DeepSeek · Kevletesteur
Params284B
Context1024K
Smallest103.2 GB
GL
GLM 5.3 Flash Heretic Abliterated LoRA V3
GLM · MorinoNushi
Params34M
Context—
Smallest0.1 GB
GL
GLM-5.3-Flash
GLM · BioDec
Params321B
Context1024K
Smallest141.7 GB
TE
Ternary Bonsai 2 27B Speculative Drafters
Ternary · NOhhh
Params1.92B
Context2K
Smallest0.0 GB
QW
Qwen3.8 27B NVFP4 MTP
Qwen · tiyuvta
Params27B
Context—
Smallest0.0 GB
TE
Swift Bonsai 2 PQ2 0 MTP Q8 0
Ternary · Bestbug
Params27.3B
Context256K
Smallest7.7 GB
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · rax4901
Params284B
Context1024K
Smallest3.8 GB