Gguf GGUF models

335 GGUF models in the Gguf family, quantized by 226 uploaders. Sizes run from 1M to 299B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GG
gguf mmproj feature layer index oob poc
Gguf · luckilytsh
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf mmproj insert layer id oob poc
Gguf · luckilytsh
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf n layer all recr oob poc
Gguf · luckilytsh
Params—
Context128
Smallest0.0 GB
GGUF
GG
gguf divzero poc
Gguf · Tuff0
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf huntr medium plus pocs 20260729
Gguf · phonglanvq
Params—
Context2K
Smallest0.0 GB
GGUF
GG
Hy MT2 1.8B
Gguf · viporg
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
GG
guard liquid d1
Gguf · faradailab
Params2.7B
Context32K
Q4_K_M1.7 GB
ReasoningTool use

Keep browsing