Pythia GGUF models

303 GGUF models in the Pythia family, quantized by 26 uploaders. Sizes run from 14M to 11.8B parameters. The longest trained context is 9K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PY
Pythia 2.8b
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PY
Pythia 410m Deduped
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
PY
Pythia 12b
Pythia · mradermacher
Params11.8B
Context2K
Q4_K_M7.6 GB
GGUF
PY
Pythia 1b Deduped
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PY
Pythia 70m
Pythia · mradermacher
Params70M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia 70m Deduped
Pythia · mradermacher
Params70M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia 2.8b v0
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PY
EleutherAI Pythia 2.8b v0
Pythia · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
PY
Pythia 70m Deduped
Pythia · mradermacher
Params70M
Context2K
Q4_K_M0.0 GB
GGUF
PY
pythia 6.9b HC3 i1
Pythia · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
PY
Pythia 160m v0
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PY
Pythia 70m
Pythia · mradermacher
Params70M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia 2.8B TLDR Iterative SamPO i1
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PY
pythia_2.8b_deduped-task065_timetravel_consistent_sentence_classification
Pythia · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PY
Pythia 70m v0
Pythia · mradermacher
Params70M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia-160M-Deduped-Adventure
Pythia · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PY
Pythia 1b Sft Hh
Pythia · RichardErkhov
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PY
Pythia 410m
Pythia · RichardErkhov
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
PY
Pythia 2.8B TLDR Iterative SamPO
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PY
pythia 14m dd rus draft
Pythia · ArtyomSubDiv
Params14M
Context2K
Smallest0.0 GB
GGUF
PY
Pythia 160m Deduped v0
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PY
pythia-2.8B-sft
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PY
Pythia 160m C2S
Pythia · mradermacher
Params162M
Context9K
Q4_K_M0.1 GB
GGUF
PY
Pythia 14m
Pythia · mradermacher
Params14M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia 70m Deduped v0
Pythia · mradermacher
Params70M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia 1.4b Deduped
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
PY
Pythia 1b Deduped v0
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PY
Pythia 1b Sft Hh
Pythia · RichardErkhov
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PY
Pythia 160m
Pythia · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PY
Pythia 2.8b
Pythia · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF

Keep browsing