Gguf GGUF models
335 GGUF models in the Gguf family, quantized by 226 uploaders. Sizes run from 1M to 299B parameters. The longest trained context is 1000K tokens.
GG
gguf metadata array overread poc
Gguf · noshkas
Params—
Context—
Smallest0.0 GB
GG
gguf sharded spin gpt2 medium alpaca e2
Gguf · Felladrin
Params406M
Context1K
Q4_K_M0.3 GB
GG
gguf malformed
Gguf · LayerFault
Params—
Context—
Smallest0.0 GB
GG
Q8_0_Gguf
Gguf · axanto
Params14.8B
Context40K
Smallest15.7 GB
GG
35b 4 gguf 0.25l
Gguf · furproxy
Params34.7B
Context256K
Smallest24.0 GB
GG
gguf spin gpt2 medium alpaca e2
Gguf · Felladrin
Params406M
Context1K
Q4_K_M0.3 GB
GG
Gguf_Multi_Modal_Model_G3_20260617
Gguf · jshwang370
Params3.88B
Context128K
Smallest7.8 GB
GG
gguf sharded pythia 1.4b sft full
Gguf · mitulagr2
Params1.41B
Context2K
Q4_K_M0.9 GB
GG
gguf offset overflow poc
Gguf · kevintsai1202
Params—
Context—
Smallest0.0 GB
GG
14b gguf arxiv
Gguf · qnguyen3
Params14.2B
Context32K
Smallest12.3 GB
GG
GGUF3_1
Gguf · NikolaiRaitschew
Params8.02B
Context32K
Smallest16.0 GB
GG
Gguf_Multi_Modal_Model_G3_20260617
Gguf · dh82
Params3.88B
Context128K
Smallest7.8 GB
GG
GGUF5
Gguf · NikolaiRaitschew
Params8.02B
Context32K
Smallest16.0 GB
GG
gguf smol500m ff
Gguf · arshjeevs
Params409M
Context8K
Q4_K_M0.3 GB
GG
gguf collection
Gguf · hesha
Params10.7B
Context8K
Smallest14.5 GB
GG
GGUF1
Gguf · NikolaiRaitschew
Params7.25B
Context32K
Smallest14.5 GB
GG
gguf clean control
Gguf · LayerFault
Params—
Context—
Smallest0.0 GB
GG
gguf dos poc
Gguf · bassia
Params—
Context—
Smallest0.0 GB
GG
Gguf_Model_20260617
Gguf · heommi
Params3.88B
Context128K
Smallest7.8 GB
GG
gguf dos poc
Gguf · WolfpackArmy
Params—
Context—
Smallest0.0 GB
GG
gguf python array dos poc
Gguf · pragnyanramtha
Params—
Context—
Smallest0.0 GB
GG
gguf invalid kv type ubsan poc
Gguf · AM-Core
Params—
Context—
Smallest0.0 GB
GG
q0.5 gguf q2
Gguf · Corizfuo
Params494M
Context32K
Smallest0.3 GB
GG
gguf crash poc
Gguf · xmd14
Params—
Context—
Smallest0.0 GB
GG
gguf poc
Gguf · ep371
Params—
Context—
Smallest0.0 GB
GG
gguf chat template metadata backdoor
Gguf · jeikei97
Params—
Context8K
Smallest0.0 GB
GG
Gguf_Sem_2
Gguf · Iliamitin
Params3.21B
Context128K
Q4_K_M2.0 GB
GG
118 gguf metadata overflow
Gguf · salnakuruvi
Params—
Context—
Smallest0.0 GB
GG
175 gguf huge dim oom
Gguf · salnakuruvi
Params—
Context—
Smallest0.0 GB
GG
gguf div0 poc
Gguf · soobsec
Params—
Context—
Smallest0.0 GB