Gpt GGUF models

724 GGUF models in the Gpt family, quantized by 143 uploaders. Sizes run from 2M to 117B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GP
GPT-NeoX-20B-Erebus
Gpt · YorkieOH10
Params20.6B
Context2K
Smallest21.9 GB
GGUF
GP
GPT 2 Cu FT V1
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
GP
GPT2XL_RLLMv19 5
Gpt · RichardErkhov
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
GP
Ov Gpt2 Fp32 No Cache
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2 Therapy1
Gpt · mradermacher
Params163M
Context250
Q4_K_M0.1 GB
GGUF
GP
gpt2 sft tldr
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
GP
GPT2 PMC i1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT2 Instruct SFT i1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt 2 health faq i1
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT2 Instruct SFT
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Medium
Gpt · tensorblock
Params406M
Context1K
Smallest0.2 GB
GGUF
GP
gpt2 small instruct
Gpt · aycandv1
Params124M
Context1K
Smallest0.3 GB
GGUF
GP
gpt2 124m fresh
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
GP
Qiyinmiss My_GPT2
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
GP
gpt2 confluence i1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Insight v1.0
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
gpt2 implicit cot multiplication 20 digits
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
GP
Gpt2 Sft Chat
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt sw3 356m exercise scenario generator v5 short
Gpt · lorinet3
Params370M
Context2K
Smallest0.2 GB
GGUF
GP
gpt2 xl
Gpt · EntityDeletr
Params1.56B
Context1K
Smallest1.3 GB
GGUF
GP
Gpt2 Medium 2 Stable Diffusion Prompt Generator
Gpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
GP
gpt 5.6 sol
Gpt · nomiraan
Params8.19B
Context128K
Smallest5.0 GB
Tool use
GP
Gpt2 Docstring Generator
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2 medical chatbot
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2-multi-news
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
nekGPT
Gpt · potteryrage
Params124M
Context1K
Smallest0.1 GB
GGUF
GP
Gpt2 Biomed Simplified
Gpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
GP
Payelb GPT2L_full
Gpt · tensorblock
Params774M
Context1K
Smallest0.3 GB
GGUF
GP
Gpt2 Medical v2
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2023 i1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF

Keep browsing