Gguf GGUF models

335 GGUF models in the Gguf family, quantized by 226 uploaders. Sizes run from 1M to 299B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GG
gguf sigfpe poc
Gguf · Breakingbad6
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf misdral
Gguf · adel11
Params7.24B
Context32K
Smallest14.5 GB
GGUF
GG
ft0724
Gguf · yh-0530
Params8.03B
Context8K
Smallest8.5 GB
GGUF
GG
gguf dos poc
Gguf · tjfwainwright
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf dos poc
Gguf · romerops7
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf ggmlpad overflow poc
Gguf · creeper-kirby
Params—
Context—
Smallest0.0 GB
GGUF
GG
Gguf_Multimodal_20260617
Gguf · eojin1
Params3.88B
Context128K
Smallest7.8 GB
GGUF
GG
gguf 1b
Gguf · kpp1923
Params988M
Context4K
Q4_K_M0.7 GB
GGUF
GG
gguf test
Gguf · bedobedo
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
GG
gguf stack crash
Gguf · jdmallin
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf poc div zero
Gguf · kartkartik
Params—
Context—
Smallest0.0 GB
GGUF
GG
GGUF 8bit model
Gguf · ari2002
Params4.4B
Context—
Smallest4.6 GB
GGUF
GG
gguf_model
Gguf · meher146
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GG
gguf quantized model
Gguf · TGrover
Params6.74B
Context2K
Smallest13.5 GB
GGUF
GG
gguf tensor dim zero fpe poc
Gguf · AM-Core
Params5M
Context2K
Smallest0.0 GB
GGUF
GG
gguf div zero poc
Gguf · ssy001
Params—
Context—
Smallest0.0 GB
GGUF
GG
q1.5 gguf q4
Gguf · Corizfuo
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
GG
my gguf test
Gguf · meguzn
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GG
gguf demo
Gguf · sarahdui
Params8.03B
Context128K
Smallest16.1 GB
GGUF
GG
gguf models
Gguf · eganlau
Params12.2B
Context1000K
Smallest7.5 GB
GGUF
GG
bt4103 gguf finance
Gguf · MartinCKY
Params3.82B
Context128K
Smallest4.1 GB
GGUF
GG
gguf sharded Q5 K 1.5 Pints 2K v0.1
Gguf · Felladrin
Params1.57B
Context16K
Smallest1.2 GB
GGUF
GG
gguf RCA
Gguf · heetha
Params3.21B
Context128K
Smallest3.4 GB
Tool use
GG
gguf fa comm a 8bit
Gguf · CuriousCat29
Params111B
Context256K
Smallest118.0 GB
GGUF
GG
gguf wasm
Gguf · app-vyeron-com
Params1.24B
Context128K
Smallest0.7 GB
GGUF
GG
gguf model
Gguf · Court1004
Params1.78B
Context128K
Smallest3.6 GB
ReasoningTool use
GG
gguf 260410
Gguf · eojin1
Params3.88B
Context128K
Smallest7.8 GB
GGUF
GG
gguf nlayer overflow poc
Gguf · ReLrO
Params—
Context4K
Smallest0.0 GB
GGUF
GG
gguf nul key confusion poc
Gguf · vilkasml
Params—
Context—
Smallest0.0 GB
GGUF
GG
gguf poc alignment nullderef
Gguf · mrrobots18
Params—
Context512
Smallest0.0 GB
GGUF

Keep browsing