Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Ahmedcarpenter
Params1.86B
Context256K
Smallest0.9 GB
FL
Flint 40B A2.5B 24GB 128k
Flint · Makdok
Params39.8B
Context256K
Smallest0.5 GB
QW
Qwen3.6 27B abliterated i1 IQ4 XS GGUF Smaller
Qwen · lemonyins
Params26.9B
Context256K
Smallest0.0 GB
DE
DeepSeek V4.1 Flash 1017 UNCENSORED VQ
DeepSeek · Baekpica
Params485M
Context—
Smallest1.0 GB
VI
Viggle Animate pruned
Viggle · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
CH
Chroma1 Base
Chroma · silveroxides
Params8.9B
Context—
Q4_K_M5.6 GB
MI
MiniCPM5 2B
MiniCPM · eaddario
Params2.52B
Context—
Smallest0.0 GB
QW
Qwen3.5 0.8B NVFP4 MTP
Qwen · michaelw9999
Params752M
Context256K
Smallest0.6 GB
BI
BiRefNet_lite
Birefnet · Acly
Params220M
Context—
Smallest0.1 GB
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · Justbackup
Params284B
Context—
Smallest10.9 GB
NT
ntt infer nvfp4
Ntt · Yehor
Params—
Context—
Smallest19.1 GB
SP
Spark X2.5 1.7B
Spark · eaddario
Params1.71B
Context—
Smallest0.0 GB
DO
Doggy
Doggy · NoahWat
Params14.3B
Context—
Smallest15.4 GB
NA
Naive N0.5 Flash Mixed Quant
Naive · AMAImedia
Params—
Context—
Smallest0.7 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Jattt6789
Params1.86B
Context256K
Smallest0.9 GB
SQ
squad-0.8b documents expert (LoRA r64: lora_A Q2_K = its 2-bit rows, lora_B Q8_0)
Squad · labqoat
Params11M
Context—
Smallest0.0 GB
GO
Google CLD3
Google · cstr
Params—
Context—
Smallest0.0 GB
AN
Anything
Anything · mzwing
Params1.07B
Context—
Smallest1.3 GB
LI
lid-fasttext-fasttext-lid176
Lid · cstr
Params33M
Context—
Smallest0.1 GB
MI
Devstral Small 2505
Mistral · eaddario
Params23.6B
Context128K
Q4_K_M12.5 GB
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · sensitivecontent
Params284B
Context1024K
Smallest10.9 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · bartowski
Params284B
Context—
Smallest10.9 GB
DE
DeepSeek V4.1 Flash 1017 REAP192
DeepSeek · patrickbdevaney
Params280B
Context1024K
Smallest8.0 GB
LI
limite 1b violetto
Limite · yamura4
Params1.07B
Context—
Q4_K_M0.7 GB
QW
mango qwen27 cyber iq4xs mtp
Qwen · isilicon
Params27.3B
Context256K
Smallest16.5 GB
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
OR
Ornith 1.5 35B A3B NVFP4 MTP
Ornith · tiyuvta
Params67M
Context—
Smallest0.0 GB
QW
qwen3.5vl 4b Q5 Q4
Qwen · tpgz
Params4.21B
Context256K
Smallest0.0 GB
GL
GLM 4.7 Flash abliterated 12GB
GLM · cognitivers
Params29.9B
Context198K
Smallest0.1 GB
PY
pydevmini1 SOTA
Pydevmini · CISCai
Params4.02B
Context—
Smallest0.0 GB