Pythia GGUF models

303 GGUF models in the Pythia family, quantized by 26 uploaders. Sizes run from 14M to 11.8B parameters. The longest trained context is 9K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PY
Pythia 1b Deduped
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PY
pythia 410m lightnovels i1
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
PY
pythia-14m
Pythia · RichardErkhov
Params14M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia 70m
Pythia · mradermacher
Params70M
Context2K
Q4_K_M0.0 GB
GGUF
PY
pythia 410m lightnovels
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
PY
Pythia 31m
Pythia · mradermacher
Params31M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia 160m Seed1
Pythia · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PY
Pythia 160m Seed3
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PY
pythia 1.4b deduped rp 420m 4k
Pythia · mradermacher
Params1.41B
Context4K
Q4_K_M0.9 GB
Roleplay
PY
Pythia 1.4b Deduped Rp 280m 4k
Pythia · mradermacher
Params1.41B
Context4K
Q4_K_M0.9 GB
Roleplay
PY
pythia-70m-deduped-alpaca-cleaned
Pythia · afrideva
Params70M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia Intervention 410m Deduped
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
PY
Pythia 160m Seed2
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PY
Vandijklab C2S Pythia 410m Diverse Single And Multi Cell Tasks
Pythia · tensorblock
Params405M
Context8K
Smallest0.2 GB
GGUF
PY
Pythia 70m
Pythia · Azzybana
Params70M
Context2K
Q4_K_M0.0 GB
Tool use
PY
EleutherAI Pythia 70m Deduped
Pythia · tensorblock
Params70M
Context2K
Smallest0.0 GB
GGUF
PY
Pythia 1b
Pythia · tensorblock
Params1.01B
Context2K
Smallest0.4 GB
GGUF
PY
Pythia 160m
Pythia · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
PY
Pythia 70M ChatSalad
Pythia · mradermacher
Params70M
Context2K
Q4_K_M0.0 GB
GGUF
PY
HWERI Pythia 70m Deduped Cleansharegpt En
Pythia · tensorblock
Params70M
Context2K
Smallest0.0 GB
GGUF
PY
Vandijklab C2S Pythia 410m Cell Type Prediction
Pythia · tensorblock
Params405M
Context4K
Smallest0.2 GB
GGUF
PY
pythia 160m dolphin extended
Pythia · tensorblock
Params162M
Context2K
Smallest0.1 GB
GGUF
PY
gguf Pythia 31M Chat v1
Pythia · Felladrin
Params31M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia 2.8b v0
Pythia · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PY
EleutherAI Pythia 1b
Pythia · tensorblock
Params1.01B
Context2K
Smallest0.4 GB
GGUF
PY
Pythia 2.8b Deduped
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
PY
Pythia 410m
Pythia · amai-gsu
Params405M
Context2K
Smallest0.2 GB
GGUF
PY
Pythia 14m
Pythia · RichardErkhov
Params14M
Context2K
Q4_K_M0.0 GB
GGUF
PY
Pythia-Chat-Base-7B
Pythia · ZeroWw
Params6.86B
Context2K
Smallest5.6 GB
GGUF
PY
Pythia 2.8b
Pythia · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF

Keep browsing