Gpt GGUF models

724 GGUF models in the Gpt family, quantized by 143 uploaders. Sizes run from 2M to 117B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GP
Overthinker_V0.5
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
GPT2XL_RLLMv17 1
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
GPT X Coder
Gpt · luxopes
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
GP
Gpt2 French Small
Gpt · Matheusrdsantos
Params124M
Context1K
Smallest0.1 GB
GGUF
GP
gpt2 llm
Gpt · ibanerjee
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
F219091 gpt2 summary
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
Gpt2 Xl
Gpt · mardakani
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
GPT2
Gpt · kaiest
Params163M
Context1K
Smallest0.3 GB
GGUF
GP
GPT2XL_RLLMv7 5
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
gpt2 Q8 0
Gpt · RonKigen
Params163M
Context1K
Smallest0.2 GB
GGUF
GP
NanoQuant
Gpt · swayamsingal
Params—
Context1K
Smallest0.0 GB
GGUF
GP
GPT Toy
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2 trained from scratch
Gpt · mardonbekhazratov
Params124M
Context1K
Smallest0.1 GB
GGUF
GP
GPT DNA
Gpt · haninmb
Params20.9B
Context128K
Smallest13.8 GB
Tool use
GP
GPT2 Glitchfur Zenith JD
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2
Gpt · Rizhk
Params124M
Context1K
Smallest0.3 GB
GGUF
GP
Gpt2 Xl
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
D Matrix Gpt2
Gpt · tensorblock
Params124M
Context1K
Smallest0.1 GB
GGUF
GP
Gpt2 Youtube Comments
Gpt · mradermacher
Params774M
Context1K
Q4_K_M0.5 GB
GGUF
GP
gpt sw3 126m
Gpt · AI-Sweden-Models
Params185M
Context2K
Smallest0.4 GB
GGUF
GP
gpt sw3 356m
Gpt · AI-Sweden-Models
Params435M
Context2K
Smallest0.9 GB
GGUF
GP
gpt sw3 126m instruct
Gpt · AI-Sweden-Models
Params185M
Context2K
Smallest0.4 GB
GGUF
GP
gpt sw3 356m instruct
Gpt · AI-Sweden-Models
Params435M
Context2K
Smallest0.9 GB
GGUF
GP
gpt sw3 6.7b v2 instruct
Gpt · AI-Sweden-Models
Params6.98B
Context2K
Q4_K_M4.5 GB
GGUF
GP
gpt sw3 6.7b v2
Gpt · AI-Sweden-Models
Params6.98B
Context2K
Q4_K_M4.5 GB
GGUF
GP
gpt sw3 20b instruct
Gpt · AI-Sweden-Models
Params20.7B
Context2K
Q4_K_M13.3 GB
GGUF
GP
gpt sw3 20b
Gpt · AI-Sweden-Models
Params20.7B
Context2K
Q4_K_M13.3 GB
GGUF
GP
gpt sw3 40b
Gpt · AI-Sweden-Models
Params39.7B
Context2K
Q4_K_M25.4 GB
GGUF
GP
gpt sw3 1.3b
Gpt · AI-Sweden-Models
Params1.47B
Context2K
Q4_K_M1.0 GB
GGUF
GP
gpt sw3 1.3b instruct
Gpt · AI-Sweden-Models
Params1.47B
Context2K
Q4_K_M1.0 GB
GGUF

Keep browsing