Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
qwen3loop 0.6b tool calling sft v1
Qwen · Lordnyx
Params596M
Context40K
Smallest0.6 GB
GGUF
QW
Qwen3.8 Whittle MoE 27B A17.8B
Qwen · Atomic-Germ
Params27B
Context—
Smallest0.0 GB
GGUF
TI
tinyllamas stories
Tinyllamas · klosax
Params134M
Context1K
Smallest0.0 GB
GGUF
MO
moshi common
Moshi · Codes4Fun
Params96M
Context—
Smallest0.3 GB
GGUF
GR
Granite 4.2 30B BE
Granite · taronaeo
Params29.3B
Context128K
Q4_K_M17.7 GB
GGUF
HO
K2 Horizon MoVA 36B A4B
Horizon · eaddario
Params37.4B
Context512K
Smallest0.3 GB
GGUF
QW
Qwen
Qwen · Kutches
Params8.95B
Context256K
Q4_K_M4.2 GB
GGUF
UP
Upscalers
Upscalers · Isi99999
Params11.9B
Context—
Smallest9.8 GB
GGUF
QW
Qwen3.8 Flash Next rcO4
Qwen · mkinc
Params177B
Context256K
Smallest0.6 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
RF
rfdetr cpp nano
Rfdetr · mudler
Params30M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8 Flash Next GSQ RCO abliterated GGUF IQ3 XXS
Qwen · KENIC-1
Params177B
Context256K
Smallest0.9 GB
GGUF
OR
Ornith 1.5 9B NVFP4 MTP
Ornith · tiyuvta
Params9B
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash DSpark drafter
DeepSeek · bleysg
Params19.8B
Context—
Smallest6.9 GB
GGUF
SD
bk sdm tiny text2img mode q4 0
Sdm · synesterai
Params530M
Context—
Smallest0.7 GB
GGUF
OR
Ornith 1.5 35B MaxQuality MTP
Ornith · offmonreal
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
WM
wmt21 dense 24 wide en x
Wmt · cstr
Params4.7B
Context—
Smallest2.7 GB
GGUF
NE
IQ2 NL IQ3 NL Test Models
Nemotron · eaddario
Params8.89B
Context1024K
Smallest0.0 GB
GGUF
LA
laya_typed_decisions_unsloth_dynamic
Laya · mys
Params423M
Context—
Q4_K_M0.4 GB
GGUF
RF
rfdetr cpp seg nano
Rfdetr · mudler
Params33M
Context—
Smallest0.0 GB
GGUF
GR
Granite 4.0 Tiny Preview BE
Granite · taronaeo
Params6.67B
Context1024K
Q4_K_M4.0 GB
GGUF
LU
Lucy Edit Dev 5b
Lucy · ThePun1sher
Params5B
Context—
Q4_K_M3.6 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · Delgon
Params51.2B
Context—
Smallest28.8 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · htrhdjy
Params1.86B
Context—
Smallest0.9 GB
GGUF
LE
lens
Lens · gguf-org
Params4.1B
Context—
Smallest0.2 GB
GGUF
OR
Ornith 1.0 35B A3B MXFP4 MOE Hybrid Imatrix
Ornith · jashepp
Params34.7B
Context256K
Smallest0.2 GB
GGUF
BI
Hy MT1.5 1.8B 1.25bit
Bit · tencent
Params1.79B
Context4K
Smallest0.5 GB
GGUF
QW
SC117 Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · jaromer
Params177B
Context256K
Smallest0.9 GB
GGUF
RA
ram_plus
Ram · Asher-1
Params332M
Context—
Smallest0.5 GB
GGUF
QW
Qwen3.5 9B distilled coding agentic
Qwen · blackshell69
Params9.2B
Context256K
Smallest0.1 GB
GGUF

Other uses

Keep browsing