Gpt GGUF models

724 GGUF models in the Gpt family, quantized by 143 uploaders. Sizes run from 2M to 117B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GP
GPT NoSleep 355m
Gpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
GP
Gpt2 1.5b
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Aidungeon2_Hf
Gpt · lukasstraub2
Params1.56B
Context1K
Smallest2.1 GB
GGUF
GP
GPT4 x AlpacaDente2 30b
Gpt · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GP
Model Openai Community Gpt2 Large Cache
Gpt · Alcoft
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
GP
Gpt2 Book Summary Generator
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Large
Gpt · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
GP
Gpt2 Large
Gpt · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
GP
GPT2 355M From Scratch
Gpt · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
GP
gpt2-conversational-or-qa
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2-turkish-128-token
Gpt · afrideva
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT3 dev 125m 0104
Gpt · k050506koch
Params164M
Context2K
Smallest0.2 GB
Coding
GP
gpt2 Q8 0
Gpt · igorbkz
Params163M
Context1K
Smallest0.2 GB
GGUF
GP
gpt2-cpt-dutch
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt4O Distil Paperwitch Abliteration L33 70b
Gpt · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
GP
gpt2-small-italian
Gpt · RichardErkhov
Params132M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2
Gpt · stratalab-org
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT2XL_RLLMv12 Layer 6
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
GPT2XL_RLLMv12 Layer 7
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
GPT2XL_RLLMv13 Layer 8
Gpt · RichardErkhov
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
GP
Gpt2 650k Stable Diffusion Prompt Generator
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
Coding
GP
Gpt2 Poems Finetuned v1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 774M Fineweb 150B
Gpt · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
GP
Gpt2 Xl OBLITERATED
Gpt · mradermacher
Params1.56B
Context1K
Q4_K_M1.2 GB
GGUF
GP
GPT2 Hacker password generator
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT Greentext 1.5b
Gpt · mradermacher
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
GP
GPT2XL_RLLMv12 Layer 5
Gpt · RichardErkhov
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
GP
gpt2_350M_edu_hermes
Gpt · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
Tool use
GP
gpt2 rlhf implementation
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF

Keep browsing