Gguf GGUF models

335 GGUF models in the Gguf family, quantized by 226 uploaders. Sizes run from 1M to 299B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GG
GGUF KCAD
Gguf · shaythuram
Params3.82B
Context128K
Smallest4.1 GB
GGUF
GG
Gguf_Multimodal_Lora_20260617
Gguf · wnduss
Params3.88B
Context128K
Smallest7.8 GB
GGUF
GG
GGUF4
Gguf · NikolaiRaitschew
Params8.02B
Context32K
Smallest16.0 GB
GGUF
GG
my bu 30b a3b gguf q6k
Gguf · Maoweicao
Params30.5B
Context256K
Smallest25.1 GB
Tool useVision
GG
my bu 30b a3b gguf q80
Gguf · Maoweicao
Params30.5B
Context256K
Smallest32.5 GB
Tool useVision
GG
Gguf_Multi_Modal_Model_G3_20260617
Gguf · jaemin01
Params3.88B
Context128K
Smallest7.8 GB
GGUF
GG
GGUF 4bit Quantized Orpheus TTS
Gguf · himanshudhingra
Params660M
Context—
Q4_K_M0.4 GB
GGUF
GG
gguf poc
Gguf · ev1lkow
Params—
Context2K
Smallest0.0 GB
GGUF
GG
GGUF2
Gguf · NikolaiRaitschew
Params7.25B
Context32K
Smallest14.5 GB
GGUF
GG
GGUF3
Gguf · NikolaiRaitschew
Params8.02B
Context32K
Smallest16.0 GB
GGUF
GG
gguf model q8
Gguf · ID2223JR
Params3.21B
Context128K
Smallest3.4 GB
Tool use
GG
gguf charsmap strlen oob
Gguf · Bytes512
Params—
Context32
Smallest0.0 GB
GGUF
GG
gguf dos poc
Gguf · ericblackgachara
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf vocab heap oob poc
Gguf · rez0
Params—
Context2K
Smallest0.0 GB
GGUF
GG
ds 1 gguf4
Gguf · simon00166
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GG
gguf test
Gguf · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
GGUF
GG
gguf 2b g
Gguf · rahul7star
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GG
Gguf_Multi_Modal_Model_G3_20260617
Gguf · junhyuk0114
Params3.88B
Context128K
Smallest7.8 GB
GGUF
GG
gguf collections
Gguf · rajivmehtapy
Params6.74B
Context8K
Smallest2.7 GB
GGUF
GG
GGUF Bad AI
Gguf · Shu12
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
GG
gguf-chat-template-backdoor-poc
Gguf · hoanghai2110
Params—
Context128
Smallest0.0 GB
GGUF
GG
gguf vulnerability pocs
Gguf · dashimubounty-bit
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf poc
Gguf · loowr
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf ndims overflow v03 poc
Gguf · xiaoyaoes
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf model q4
Gguf · ID2223JR
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GG
106 gguf tensor overflow
Gguf · salnakuruvi
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf med
Gguf · Shay1309
Params3.61B
Context128K
Smallest3.8 GB
Tool use
GG
gguf memory exhaustion v02 poc
Gguf · xiaoyaoes
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf array overflow poc
Gguf · aTmHnTR
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf loadtime parser poc
Gguf · aTmHnTR
Params—
Context—
Smallest0.0 GB
GGUF

Keep browsing