Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LO
locate anything.cpp
Locateanything · mudler
Params3.83B
Context—
Smallest4.7 GB
GGUF
QW
Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · SC117
Params177B
Context256K
Smallest0.9 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · HauhauCS
Params30B
Context—
Smallest0.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 GSQ RCO
DeepSeek · ISTA-DASLab
Params197B
Context—
Smallest110.6 GB
GGUF
DE
DeepSeek V4.1 Flash Vision Encoder
DeepSeek · antirez
Params1400B
Context—
Smallest1.0 GB
GGUF
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · huihui-ai
Params10B
Context—
Smallest10.9 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · SC117
Params177B
Context256K
Smallest0.9 GB
GGUF
QW
Qwen3.8 Flash Next NVFP4 GPTQ Strata
Qwen · Maximilian228
Params51.2B
Context—
Smallest1.3 GB
GGUF
MI
MiniMax H3 GGUFs
Minimax · realrebelai
Params33.1B
Context—
Q4_K_M14.6 GB
GGUF
OR
Tiel Coder 35B A3B
Ornith · peculiar-ragdoll
Params34.7B
Context256K
Smallest0.2 GB
GGUF
QW
Qwen3.8 Flash Next abliterated GSQ RCO Strata
Qwen · alesha-pro
Params—
Context—
Smallest0.0 GB
GGUF
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · huihui-ai
Params50B
Context—
Smallest3.8 GB
GGUF
DE
DeepSeek V4.1 Flash 1017
DeepSeek · unsloth
Params748B
Context1024K
Smallest8.0 GB
GGUF
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO GGUF NInfer
Qwen · nerkyor
Params27.3B
Context256K
Smallest0.0 GB
GGUF
QW
Qwen3.8 27B Defiance Uncensored MTP
Qwen · ttindall
Params27.3B
Context—
Smallest0.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS
DeepSeek · Abiray
Params197B
Context—
Smallest110.6 GB
GGUF
QW
Qwen3.6 35B A3B NVFP4 MTP
Qwen · michaelw9999
Params35.5B
Context256K
Smallest20.4 GB
GGUF
QW
Qwopus3.6 27B v2
Qwopus · michaelw9999
Params27.3B
Context256K
Smallest16.1 GB
GGUF
QW
Qwopus3.6 27B Coder
Qwopus · michaelw9999
Params27.3B
Context256K
Smallest16.2 GB
GGUF
QW
Qwen3.6 27B NVFP4 MTP
Qwen · michaelw9999
Params27.3B
Context256K
Smallest16.2 GB
GGUF
KR
KREA 2 GGUFs
Krea · realrebelai
Params12.9B
Context—
Q4_K_M7.2 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · unsloth
Params284B
Context—
Smallest10.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Maya
DeepSeek · peasantsmith
Params748B
Context—
Smallest276.6 GB
GGUF
MI
MiniCPM V 4.7 35B A3B Uncensored
MiniCPM · AtomicChat
Params34.7B
Context256K
Smallest0.1 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 ds4
DeepSeek · nazeshinjite
Params755B
Context—
Smallest1.0 GB
GGUF
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · unsloth
Params7.52B
Context128K
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash GSQ RCO
DeepSeek · pfeifferj
Params748B
Context—
Smallest9.3 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · audreyt
Params755B
Context—
Smallest365.7 GB
GGUF
GL
GLM-5.3-Flash Vision Encoder
GLM · antirez
Params321B
Context—
Smallest1.1 GB
GGUF
TE
test gguf sample
Test · Isotr0py
Params29M
Context—
Smallest0.0 GB
GGUF

About Other GGUF models

4,481 GGUF models are filed under Other: GGUF models that are not language models and not clearly image or audio. The most downloaded are locate anything.cpp, Qwen3.8 Flash Next GSQ RCO abliterated and Qwen3.8 27B Uncensored HauhauCS Aggressive MTP. Parameter counts run from 1M to 2780B, and the longest trained context window is 10240K tokens.

These GGUF files are not language models. Check the model page on Hugging Face for the right runtime. The families you will see most are Qwen (838), DeepSeek (324) and Llama (307).

Frequently asked questions

What are Other GGUF models?

GGUF models that are not language models and not clearly image or audio. There are 4,481 of them on this site.

Which Other GGUF model should I start with?

The most downloaded is locate anything.cpp. Choose the size that fits your GPU, then a Q4_K_M quant unless you have memory to spare.

Other uses

Keep browsing