Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek V4 Flash Strix Halo
DeepSeek · otheru
Params284B
Context1024K
Smallest10.9 GB
MA
mageflow
Mage · gguf-org
Params4.12B
Context—
Smallest0.3 GB
VO
vox jot models
Vox · IrieDinamik
Params4.43B
Context—
Q4_K_M2.9 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive Q6 K P
Qwen · leothebella
Params27.3B
Context256K
Smallest25.9 GB
RA
raon-opentts-1b-f16
Raon · cstr
Params1.06B
Context—
Smallest2.8 GB
QW
Qwen3 VL 8B Thinking
Qwen · NexaAI
Params8.19B
Context—
Smallest4.6 GB
GE
gemma 4 31B it SDFT Heretic RP
Gemma · Ilya626
Params107M
Context—
Smallest0.2 GB
OP
opus-mt-en-es
Opus · cstr
Params78M
Context—
Smallest0.1 GB
QU
quant type
Quant · gguf-org
Params—
Context—
Q4_K_M0.0 GB
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · vultr
Params284B
Context1024K
Smallest10.9 GB
DE
DeepSeek V4 Flash Vision Exp Q8 0 MXFP4 Q3 K Q2 K mixed
DeepSeek · BahamutRU
Params284B
Context1024K
Smallest128.0 GB
FA
fabric llm finetune bitnet
Fabric · qvac
Params1.27B
Context2K
Smallest0.0 GB
WO
Gryphe WorldSim Opus 3.6 35B A3B iQ compact APEX
Worldsim · Koshkasa
Params48M
Context—
Smallest0.2 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · minte1431
Params1.86B
Context256K
Smallest0.9 GB
QW
Qwen3.8 27B Absolute Heresy LoRA
Qwen · MuXodious
Params69M
Context—
Smallest0.1 GB
BG
bge m3 Q8A64
BGE · VelociQ8
Params865M
Context8K
Smallest0.9 GB
MI
MiniMax M2 REAP 162B A10B i1
Minimax · mradermacher
Params162B
Context192K
Smallest0.3 GB
DE
DeepSeek V4.1 Flash 1017 GSQ RCO DSPARK
DeepSeek · neuralll
Params748B
Context1024K
Smallest4.9 GB
LF
LFM2.5 8B A1B Opus Distil Q5 K M imat
Lfm · DarkKitsune
Params8.47B
Context125K
Smallest0.0 GB
MI
Candle MistralTrix v1
Mistral · DanielClough
Params8.99B
Context—
Smallest2.9 GB
GG
ggml CLIP ViT B 32 laion2B s34B b79K
Ggml · mys
Params151M
Context—
Smallest0.0 GB
QW
Qwen3.6 27B
Qwen · zerodigest
Params27.3B
Context256K
Smallest10.0 GB
LI
Ling flash 2.0 i1
Ling · mradermacher
Params103B
Context32K
Smallest0.3 GB
SU
SuperDeepseek V4 Flash abliterated IK
Superdeepseek · KeinNiemand
Params284B
Context1024K
Smallest65.4 GB
AL
all MiniLM L6 v2 BE
All · taronaeo
Params23M
Context512
Q4_K_M0.0 GB
TE
Ternary Bonsai 2 2B Uncensored LoRA
Ternary · AtomicChat
Params2B
Context—
Smallest0.0 GB
TE
textcht
Textcht · HuggingbaseHuggingbase
Params32.8B
Context256K
Smallest0.9 GB
EM
embeddinggemma 2 ft typed decision
Embeddinggemma · cstr
Params272M
Context—
Smallest0.3 GB
QW
Qwen 36 27
Qwen · havenoammo
Params425M
Context256K
Smallest0.5 GB
TU
TURNA
Turna · helizac
Params1.14B
Context—
Smallest0.4 GB