Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash 0731 REAM96 111B DS4
DeepSeek · WaveCut
Params111B
Context1024K
Smallest6.0 GB
GGUF
QW
Qwen.Qwen3 VL Embedding 2B
Qwen · TitleOS
Params407M
Context—
Smallest0.8 GB
GGUF
NE
NVIDIA Nemotron 3 Super 120B A12B
Nemotron · AesSedai
Params121B
Context1024K
Smallest0.3 GB
GGUF
ST
streaming sortformer
Streaming · selfovercoming
Params118M
Context—
Smallest0.1 GB
GGUF
SA
SauerkrautLM MoEdernColBERT 27M CrispEmbed
Sauerkrautlm · cstr
Params27M
Context—
Smallest0.0 GB
GGUF
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · noctrex
Params35.5B
Context256K
Smallest20.4 GB
GGUF
MY
mydata comply faq model
Mydata · georgatos
Params118M
Context—
Smallest0.1 GB
GGUF
TI
LS Tiny Base
Tiny · Dsg2
Params20M
Context—
Q4_K_M0.0 GB
GGUF
GL
GLM Steam 106B A12B v1 i1
GLM · mradermacher
Params110B
Context128K
Smallest0.2 GB
GGUF
GR
granite 4.2 8b G Q5
Granite · darioooooo0o
Params8.79B
Context128K
Smallest0.0 GB
GGUF
PH
LoRA Phi 4 Abliterated
Phi · ggml-org
Params119M
Context—
Smallest0.5 GB
GGUF
ET
ettin reranker 68m v1
Ettin · cstr
Params69M
Context—
Smallest0.1 GB
GGUF
QW
qwen3.5 9b qworus Q5 imat
Qwen · DarkKitsune
Params8.95B
Context1024K
Smallest0.0 GB
GGUF
QW
Qwen3.8 Flash Next Abliterated Adapter
Qwen · apetersson
Params80M
Context—
Smallest0.3 GB
GGUF
DE
mirxa DeepSeek V4 Flash 0731
DeepSeek · mirxa2
Params284B
Context1024K
Smallest10.9 GB
GGUF
ME
MeinaMixFinal
Meinamixfinal · DaNS2025
Params860M
Context—
Smallest1.4 GB
GGUF
SM
SmallThinker 4B A0.6B Instruct MXFP4 MOE
Smallthinker · noctrex
Params4.27B
Context32K
Smallest0.0 GB
GGUF
IM
Z Image Turbo Art
Image · vjump21848
Params6.15B
Context—
Q4_K_M5.0 GB
GGUF
SM
smolvlm
Smolvlm · SkyContact
Params256M
Context—
Smallest0.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 UNCENSORED VQ
DeepSeek · shad0wsh00ck
Params485M
Context—
Smallest1.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 V3 IQ1S
DeepSeek · cliecy
Params748B
Context1024K
Smallest223.8 GB
GGUF
RM
rmbg onnx
Rmbg · mujibanget
Params220M
Context—
Smallest0.9 GB
GGUF
QW
Qwen3-ForcedAligner 0.6B
Qwen · Adit2K
Params918M
Context—
Smallest1.0 GB
GGUF
PO
posformer hw
Posformer · cstr
Params7M
Context—
Smallest0.0 GB
GGUF
KA
kanana 2 v decide 3b 2611
Kanana · jaesang-lee
Params3.18B
Context32K
Smallest0.0 GB
GGUF
QW
ApocalypseParty Qwen3.5 27B v3 SFT 2 IK 16GB
Qwen · Koshkasa
Params27.3B
Context256K
Smallest0.0 GB
GGUF
MI
MiniMax H3 GGUFs
Minimax · hnao23
Params33.1B
Context—
Q4_K_M14.6 GB
GGUF
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · Keepser
Params284B
Context1024K
Smallest3.8 GB
GGUF
LL
llama 2 7b chat tagalog v0.3
Llama · 922-Narra
Params6.74B
Context2K
Smallest4.2 GB
GGUF
ER
ERNIE Image
Ernie · Solictous
Params8.03B
Context—
Smallest0.2 GB
GGUF

Other uses

Keep browsing