Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Ahmedcarpenter
Params1.86B
Context256K
Smallest0.9 GB
GGUF
FL
Flint 40B A2.5B 24GB 128k
Flint · Makdok
Params39.8B
Context256K
Smallest0.5 GB
GGUF
QW
Qwen3.6 27B abliterated i1 IQ4 XS GGUF Smaller
Qwen · lemonyins
Params26.9B
Context256K
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 UNCENSORED VQ
DeepSeek · Baekpica
Params485M
Context—
Smallest1.0 GB
GGUF
VI
Viggle Animate pruned
Viggle · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
CH
Chroma1 Base
Chroma · silveroxides
Params8.9B
Context—
Q4_K_M5.6 GB
GGUF
MI
MiniCPM5 2B
MiniCPM · eaddario
Params2.52B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.5 0.8B NVFP4 MTP
Qwen · michaelw9999
Params752M
Context256K
Smallest0.6 GB
GGUF
BI
BiRefNet_lite
Birefnet · Acly
Params220M
Context—
Smallest0.1 GB
GGUF
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · Justbackup
Params284B
Context—
Smallest10.9 GB
GGUF
NT
ntt infer nvfp4
Ntt · Yehor
Params—
Context—
Smallest19.1 GB
GGUF
SP
Spark X2.5 1.7B
Spark · eaddario
Params1.71B
Context—
Smallest0.0 GB
GGUF
DO
Doggy
Doggy · NoahWat
Params14.3B
Context—
Smallest15.4 GB
GGUF
NA
Naive N0.5 Flash Mixed Quant
Naive · AMAImedia
Params—
Context—
Smallest0.7 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Jattt6789
Params1.86B
Context256K
Smallest0.9 GB
GGUF
SQ
squad-0.8b documents expert (LoRA r64: lora_A Q2_K = its 2-bit rows, lora_B Q8_0)
Squad · labqoat
Params11M
Context—
Smallest0.0 GB
GGUF
GO
Google CLD3
Google · cstr
Params—
Context—
Smallest0.0 GB
GGUF
AN
Anything
Anything · mzwing
Params1.07B
Context—
Smallest1.3 GB
GGUF
LI
lid-fasttext-fasttext-lid176
Lid · cstr
Params33M
Context—
Smallest0.1 GB
GGUF
MI
Devstral Small 2505
Mistral · eaddario
Params23.6B
Context128K
Q4_K_M12.5 GB
GGUF
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · sensitivecontent
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · bartowski
Params284B
Context—
Smallest10.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 REAP192
DeepSeek · patrickbdevaney
Params280B
Context1024K
Smallest8.0 GB
GGUF
LI
limite 1b violetto
Limite · yamura4
Params1.07B
Context—
Q4_K_M0.7 GB
GGUF
QW
mango qwen27 cyber iq4xs mtp
Qwen · isilicon
Params27.3B
Context256K
Smallest16.5 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
OR
Ornith 1.5 35B A3B NVFP4 MTP
Ornith · tiyuvta
Params67M
Context—
Smallest0.0 GB
GGUF
QW
qwen3.5vl 4b Q5 Q4
Qwen · tpgz
Params4.21B
Context256K
Smallest0.0 GB
GGUF
GL
GLM 4.7 Flash abliterated 12GB
GLM · cognitivers
Params29.9B
Context198K
Smallest0.1 GB
GGUF
PY
pydevmini1 SOTA
Pydevmini · CISCai
Params4.02B
Context—
Smallest0.0 GB
GGUF

Other uses

Keep browsing