Gpt GGUF models

724 GGUF models in the Gpt family, quantized by 143 uploaders. Sizes run from 2M to 117B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GP
GPT2XL_RLLMv13 Layer 5
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
gpt2-small-dutch
Gpt · RichardErkhov
Params147M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT2XL_RLLMv3 PTT 3
Gpt · RichardErkhov
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
GP
gpt2 squad nqg hl
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2 mi reflector
Gpt · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
GP
gpt2 dolly i1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2 xl
Gpt · QuantFactory
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GP
Gpt2 Medium
Gpt · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
GP
Gpt2 Wikitext 9180
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT2.5.2 High Reasoning Codex 0.4B
Gpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
Reasoning
GP
Gpt2 Medium
Gpt · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
GP
Gpt2 Insight v1.2
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
GPT Greentext 355m i1
Gpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
GP
gpt2-small-arabic
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2 conversational or qa
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Xl_Hh_Harmful
Gpt · mradermacher
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
GP
Gpt2 Therapist Finetuned
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT2 Chatbot Nepali For Disaster
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt Nyc Nontoxic
Gpt · mradermacher
Params125M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Medium 650k Stable Diffusion Prompt Generator
Gpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
GP
GPT4 x AlpacaDente2 30b i1
Gpt · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
GP
Gpt2_Oasst2_Curated
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT2 Azure DevOps
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2bis
Gpt · batmac
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Pt Stable Diffusion Prompt Generator
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Medium Stable Diffusion Prompt Generator
Gpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
GP
Gpt Neox 20b
Gpt · RichardErkhov
Params20.6B
Context2K
Q4_K_M13.1 GB
GGUF
GP
Gpt2 Demo
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
MicroLLM2
Gpt · MLVXN
Params1.56B
Context1K
Q4_K_M1.2 GB
GGUF
GP
gpt4 x alpaca
Gpt · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF

Keep browsing