GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
TA
Tai 70B
Tai · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
VE
Venus 103b v1.1
Venus · TheBloke
Params103B
Context4K
Smallest43.5 GB
GGUF
LL
undi95_llamix2-mlewd-4x13b
Llamix · TheBloke
Params38.5B
Context32K
Smallest21.7 GB
GGUF
CU
cutie
Cutie · TheBloke
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
ME
Megamix A1 13B
Megamix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SO
Solus 70B L2
Solus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MA
Marcoroni 70B v1
Marcoroni · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LI
Lila 103B L2
Lila · TheBloke
Params103B
Context4K
Smallest43.5 GB
GGUF
UN
UndiMix v4 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TE
Tess XL v1.0
Tess · TheBloke
Params118B
Context4K
Smallest49.6 GB
GGUF
VE
Venus 103b v1.2
Venus · TheBloke
Params103B
Context4K
Smallest43.5 GB
GGUF
WI
WinterGoliath 123b
Wintergoliath · TheBloke
Params124B
Context4K
Smallest45.3 GB
GGUF

Keep browsing