Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek V4 Flash 0731 REAM96 111B DS4
DeepSeek · WaveCut
Params111B
Context1024K
Smallest6.0 GB
QW
Qwen.Qwen3 VL Embedding 2B
Qwen · TitleOS
Params407M
Context—
Smallest0.8 GB
NE
NVIDIA Nemotron 3 Super 120B A12B
Nemotron · AesSedai
Params121B
Context1024K
Smallest0.3 GB
ST
streaming sortformer
Streaming · selfovercoming
Params118M
Context—
Smallest0.1 GB
SA
SauerkrautLM MoEdernColBERT 27M CrispEmbed
Sauerkrautlm · cstr
Params27M
Context—
Smallest0.0 GB
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · noctrex
Params35.5B
Context256K
Smallest20.4 GB
MY
mydata comply faq model
Mydata · georgatos
Params118M
Context—
Smallest0.1 GB
TI
LS Tiny Base
Tiny · Dsg2
Params20M
Context—
Q4_K_M0.0 GB
GL
GLM Steam 106B A12B v1 i1
GLM · mradermacher
Params110B
Context128K
Smallest0.2 GB
GR
granite 4.2 8b G Q5
Granite · darioooooo0o
Params8.79B
Context128K
Smallest0.0 GB
PH
LoRA Phi 4 Abliterated
Phi · ggml-org
Params119M
Context—
Smallest0.5 GB
ET
ettin reranker 68m v1
Ettin · cstr
Params69M
Context—
Smallest0.1 GB
QW
qwen3.5 9b qworus Q5 imat
Qwen · DarkKitsune
Params8.95B
Context1024K
Smallest0.0 GB
QW
Qwen3.8 Flash Next Abliterated Adapter
Qwen · apetersson
Params80M
Context—
Smallest0.3 GB
DE
mirxa DeepSeek V4 Flash 0731
DeepSeek · mirxa2
Params284B
Context1024K
Smallest10.9 GB
ME
MeinaMixFinal
Meinamixfinal · DaNS2025
Params860M
Context—
Smallest1.4 GB
SM
SmallThinker 4B A0.6B Instruct MXFP4 MOE
Smallthinker · noctrex
Params4.27B
Context32K
Smallest0.0 GB
IM
Z Image Turbo Art
Image · vjump21848
Params6.15B
Context—
Q4_K_M5.0 GB
SM
smolvlm
Smolvlm · SkyContact
Params256M
Context—
Smallest0.4 GB
DE
DeepSeek V4.1 Flash 1017 UNCENSORED VQ
DeepSeek · shad0wsh00ck
Params485M
Context—
Smallest1.0 GB
DE
DeepSeek V4.1 Flash 1017 V3 IQ1S
DeepSeek · cliecy
Params748B
Context1024K
Smallest223.8 GB
RM
rmbg onnx
Rmbg · mujibanget
Params220M
Context—
Smallest0.9 GB
QW
Qwen3-ForcedAligner 0.6B
Qwen · Adit2K
Params918M
Context—
Smallest1.0 GB
PO
posformer hw
Posformer · cstr
Params7M
Context—
Smallest0.0 GB
KA
kanana 2 v decide 3b 2611
Kanana · jaesang-lee
Params3.18B
Context32K
Smallest0.0 GB
QW
ApocalypseParty Qwen3.5 27B v3 SFT 2 IK 16GB
Qwen · Koshkasa
Params27.3B
Context256K
Smallest0.0 GB
MI
MiniMax H3 GGUFs
Minimax · hnao23
Params33.1B
Context—
Q4_K_M14.6 GB
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · Keepser
Params284B
Context1024K
Smallest3.8 GB
LL
llama 2 7b chat tagalog v0.3
Llama · 922-Narra
Params6.74B
Context2K
Smallest4.2 GB
ER
ERNIE Image
Ernie · Solictous
Params8.03B
Context—
Smallest0.2 GB