Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
qwen3loop 0.6b tool calling sft v1
Qwen · Lordnyx
Params596M
Context40K
Smallest0.6 GB
QW
Qwen3.8 Whittle MoE 27B A17.8B
Qwen · Atomic-Germ
Params27B
Context—
Smallest0.0 GB
TI
tinyllamas stories
Tinyllamas · klosax
Params134M
Context1K
Smallest0.0 GB
MO
moshi common
Moshi · Codes4Fun
Params96M
Context—
Smallest0.3 GB
GR
Granite 4.2 30B BE
Granite · taronaeo
Params29.3B
Context128K
Q4_K_M17.7 GB
HO
K2 Horizon MoVA 36B A4B
Horizon · eaddario
Params37.4B
Context512K
Smallest0.3 GB
QW
Qwen
Qwen · Kutches
Params8.95B
Context256K
Q4_K_M4.2 GB
UP
Upscalers
Upscalers · Isi99999
Params11.9B
Context—
Smallest9.8 GB
QW
Qwen3.8 Flash Next rcO4
Qwen · mkinc
Params177B
Context256K
Smallest0.6 GB
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
RF
rfdetr cpp nano
Rfdetr · mudler
Params30M
Context—
Smallest0.0 GB
QW
Qwen3.8 Flash Next GSQ RCO abliterated GGUF IQ3 XXS
Qwen · KENIC-1
Params177B
Context256K
Smallest0.9 GB
OR
Ornith 1.5 9B NVFP4 MTP
Ornith · tiyuvta
Params9B
Context—
Smallest0.0 GB
DE
DeepSeek V4 Flash DSpark drafter
DeepSeek · bleysg
Params19.8B
Context—
Smallest6.9 GB
SD
bk sdm tiny text2img mode q4 0
Sdm · synesterai
Params530M
Context—
Smallest0.7 GB
OR
Ornith 1.5 35B MaxQuality MTP
Ornith · offmonreal
Params35.5B
Context256K
Q4_K_M21.7 GB
WM
wmt21 dense 24 wide en x
Wmt · cstr
Params4.7B
Context—
Smallest2.7 GB
NE
IQ2 NL IQ3 NL Test Models
Nemotron · eaddario
Params8.89B
Context1024K
Smallest0.0 GB
LA
laya_typed_decisions_unsloth_dynamic
Laya · mys
Params423M
Context—
Q4_K_M0.4 GB
RF
rfdetr cpp seg nano
Rfdetr · mudler
Params33M
Context—
Smallest0.0 GB
GR
Granite 4.0 Tiny Preview BE
Granite · taronaeo
Params6.67B
Context1024K
Q4_K_M4.0 GB
LU
Lucy Edit Dev 5b
Lucy · ThePun1sher
Params5B
Context—
Q4_K_M3.6 GB
QW
Qwen3.8 Flash Next
Qwen · Delgon
Params51.2B
Context—
Smallest28.8 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · htrhdjy
Params1.86B
Context—
Smallest0.9 GB
LE
lens
Lens · gguf-org
Params4.1B
Context—
Smallest0.2 GB
OR
Ornith 1.0 35B A3B MXFP4 MOE Hybrid Imatrix
Ornith · jashepp
Params34.7B
Context256K
Smallest0.2 GB
BI
Hy MT1.5 1.8B 1.25bit
Bit · tencent
Params1.79B
Context4K
Smallest0.5 GB
QW
SC117 Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · jaromer
Params177B
Context256K
Smallest0.9 GB
RA
ram_plus
Ram · Asher-1
Params332M
Context—
Smallest0.5 GB
QW
Qwen3.5 9B distilled coding agentic
Qwen · blackshell69
Params9.2B
Context256K
Smallest0.1 GB