Pythia GGUF models

303 GGUF models in the Pythia family, quantized by 26 uploaders. Sizes run from 14M to 11.8B parameters. The longest trained context is 9K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context4K
Q4_K_M0.3 GB
GGUF
PY
pythia-160m_ft_CookingRecipes
Pythia · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PY
Pythia 1.4b Deduped v0
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
PY
pythia1b-sft-tldr
Pythia · RichardErkhov
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PY
Pythia 1b Deduped v0
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PY
Pythia 160m Deduped
Pythia · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PY
Pythia 410m Deduped v0
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
PY
pythia-2.8B-sft
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PY
Pythia 70m Deduped
Pythia · mradermacher
Params70M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia 410m Deduped v0
Pythia · RichardErkhov
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
PY
Pythia 1b Sft Hh
Pythia · RichardErkhov
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PY
Pythia 1b
Pythia · RichardErkhov
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PY
Pythia 410m Deduped v0
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
PY
Pythia 70m v0
Pythia · mradermacher
Params70M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia 2.8b
Pythia · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PY
Pythia 1.4b
Pythia · RichardErkhov
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
PY
Pythia 1.4b
Pythia · RichardErkhov
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
PY
Pythia 1.4b Deduped
Pythia · RichardErkhov
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
PY
Pythia 160m v0
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PY
gguf Pythia Chat Base 7B
Pythia · Felladrin
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PY
Pythia 1b Deduped
Pythia · RichardErkhov
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PY
Pythia 2.8b
Pythia · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PY
Pythia 160m
Pythia · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PY
Pythia 1b v0
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PY
Pythia 410m v0
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
PY
Pythia 1.4b Deduped
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
PY
Pythia 6.9b
Pythia · RichardErkhov
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
PY
Pythia 2.8b
Pythia · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PY
Pythia 2.8b Deduped v0
Pythia · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF

Keep browsing