Distilgpt GGUF models

88 GGUF models in the Distilgpt family, quantized by 13 uploaders. Sizes run from 82M to 3.21B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
Coding
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
distilgpt2-stable-diffusion-v2
Distilgpt · RichardErkhov
Params121M
Context1K
Smallest0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
GGUF
DI
distilgpt2-wiki-qa
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
distilgpt2-emailgen
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · ysn-rfd
Params121M
Context1K
Smallest0.1 GB
GGUF
DI
distilgpt2 medical finetuned
Distilgpt · mradermacher
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · deepshika
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · Panda4715
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · tensorblock
Params—
Context1K
Smallest0.0 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · Jaewoo49
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
distilgpt2 medical finetuned i1
Distilgpt · mradermacher
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
reasonyx
Distilgpt · synthdragon-studios
Params3.21B
Context128K
Smallest2.0 GB
CodingReasoningTool use
DI
Distilgpt2
Distilgpt · chaudhary118
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · fareshzm
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
DI
distilgpt2
Distilgpt · PaoloRosa
Params121M
Context1K
Smallest0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · Jaewoo49
Params82M
Context1K
Smallest0.1 GB
GGUF
DI
Distilgpt2 Fake News Detector
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF

Keep browsing