Distilgpt GGUF models

88 GGUF models in the Distilgpt family, quantized by 13 uploaders. Sizes run from 82M to 3.21B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2 Finetuned Finance
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2 Proofs
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2 Multiprompt v1
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2 Emailgen V2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
distilgpt2 multiprompt i1
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
GGUF
DI
DistilGPT
Distilgpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
distilgpt2-emailgen-V2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
distilgpt2-base-pretrained-he
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2 Proofs
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
GGUF
DI
Distilbert Distilgpt2
Distilgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · shahzeb171
Params82M
Context1K
Smallest0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF

Keep browsing