Gpt GGUF models

724 GGUF models in the Gpt family, quantized by 143 uploaders. Sizes run from 2M to 117B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GP
Overthinker_V1.5
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Medical v2
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt Nyc Affirmations
Gpt · mradermacher
Params125M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT-Sw3-356M-GGUF
Gpt · timpal0l
Params435M
Context2K
Smallest0.9 GB
GGUF
GP
gpt2 Therapy2
Gpt · mradermacher
Params163M
Context250
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Finetuned
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Finetuned Recipes Cooking
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Overthinker_V1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2_Individuated_Zero_Chaos
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
Demo Leaderboard Gpt2 Demo
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
GP
GPT2 PMC
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
GP
GPT2 medical
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2 rewrite i1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Xl
Gpt · antoste
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
Gpt2 Therapist Finetuned
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
GP
GPT2XL_RLLMv18 3
Gpt · RichardErkhov
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
GP
Gpt Neox 20b
Gpt · 1bit-MONSTER
Params20.6B
Context2K
Q4_K_M13.1 GB
GGUF
GP
gpt 5.6 sol
Gpt · zeeburgers
Params8.19B
Context128K
Smallest5.0 GB
Tool use
GP
Gpt Neox 20b Fiction Novel Generation
Gpt · ywms666
Params20.6B
Context2K
Q4_K_M13.1 GB
GGUF
GP
GPT2XL_RLLMv16 5
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
Gpt2 Large Lora Sft1
Gpt · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
GP
Gpt2_Finetune_Alpaca
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
GP
GPT2XL_RLLMv1.21 9
Gpt · RichardErkhov
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
GP
gpt2-xl
Gpt · anester
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
gpt-sw3-6.7b-v2-instruct
Gpt · timpal0l
Params6.98B
Context2K
Q4_K_M4.5 GB
GGUF
GP
gpt2 Q4 K M
Gpt · enacimie
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT2
Gpt · svshrithik12
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT2XL_RLLMv16 7
Gpt · RichardErkhov
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
GP
gpt2 horror stories i1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Tv Caption
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF

Keep browsing