Gpt GGUF models

724 GGUF models in the Gpt family, quantized by 143 uploaders. Sizes run from 2M to 117B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GP
GPT NeoX 20B Erebus
Gpt · mradermacher
Params20.6B
Context2K
Q4_K_M13.1 GB
GGUF
GP
GPT Grug 355m i1
Gpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
GP
gpt2 finetuned yannic test i1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Hertiage Foundation
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt Nyc
Gpt · mradermacher
Params356M
Context1K
Q4_K_M0.2 GB
GGUF
GP
GPT3 dev 350m 2805
Gpt · k050506koch
Params356M
Context2K
Q4_K_M0.2 GB
Coding
GP
Gpt Nyc Small
Gpt · mradermacher
Params125M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT Grug 355m
Gpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
GP
gpt2 large
Gpt · QuantFactory
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
GP
GPT Greentext 1.5b i1
Gpt · mradermacher
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
GP
GPT 2.5.2 NSFW Codex 0.4B
Gpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
Reasoning
GP
GPT Z
Gpt · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
ReasoningTool use
GP
Gpt2 Large
Gpt · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
GP
Gpt2 Cia World Factbook
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Medium
Gpt · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
GP
Gpt2 Medium
Gpt · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
GP
gpt2-medium-italian-embeddings
Gpt · RichardErkhov
Params365M
Context1K
Q4_K_M0.2 GB
Embedding
GP
Gpt Neox 20b Embeddings
Gpt · mradermacher
Params20.6B
Context2K
Q4_K_M13.1 GB
Embedding
GP
GPT4chan 24B
Gpt · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
GP
sp8108 gpt2 finetuned ros2 v3
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2 stable diffusion prompt generator i1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 650k Stable Diffusion Prompt Generator
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
Coding
GP
GPT NoSleep 1.5b i1
Gpt · mradermacher
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
GP
gpt2 alpaca gpt4 i1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT Para
Gpt · mradermacher
Params1.56B
Context1K
Q4_K_M1.1 GB
GGUF
GP
gpt human assistant i1
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Context_Generator
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Large
Gpt · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
GP
Gpt2Finetuned
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF

Keep browsing