Stackexchange GGUF models

74 GGUF models in the Stackexchange family, quantized by 4 uploaders. Sizes run from 8.03B to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ST
stackexchange hermeneutics
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange law
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange engineering
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ST
stackexchange codereview
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
ST
stackexchange quant
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange graphicdesign
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ST
stackexchange gamedev
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ST
stackexchange codegolf
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange devops
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange chinese
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
stackexchange robotics
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ST
stackexchange avp
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ST
stackexchange parenting Q2 K
Stackexchange · Aescleah
Params8.03B
Context128K
Smallest3.2 GB
GGUF
ST
stackexchange cs
Stackexchange · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing