GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
TU
allenai_tulu-13b
Tulu · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NE
sanjiwatsuki_neural-chat-7b-v3-3-wizardmath-dare-me
Neural · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BE
BerrySauce L2 13B
Berrysauce · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GR
greennode_greennodelm-7b-v4leo
Greennodelm · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
weyaxi_openorca-zephyr-7b
Openorca · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NU
nurtureai_synthia-7b-v2.0-16k
Nurtureai · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StableBeluga 7B
Stablebeluga · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TI
gryphe_tiamat-7b
Tiamat · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FL
undi95_flatdolphinmaid-8x7b
Flatdolphinmaid · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
NO
X NoroChronos 13B
Norochronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ZE
royallab_zephrp-m7b
Zephrp · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VE
delcos_velara
Velara · TheBloke
Params11.4B
Context32K
Q4_K_M6.8 GB
GGUF
LL
llemma 34b
Llemma · TheBloke
Params33.7B
Context4K
Q4_K_M20.2 GB
Reasoning
TU
allenai_tulu-2-13b
Tulu · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
BR
rwitz2_go-bruins-v2.1.1
Bruins · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZA
Zarablend L2 7B
Zarablend · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
Samantha 1.1 70B
Samantha · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
HU
Huginn v3 13B
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
YI
platypus yi 34b
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
ME
MegaMix T1 13B
Megamix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GO
goliath 120b
Goliath · TheBloke
Params118B
Context4K
Smallest49.6 GB
GGUF
BA
jondurbin_bagel-8x7b-v0.2
Bagel · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CodingRoleplay
LL
Llama2 22B GPLATTY
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
MI
minirecord_mini_synatra_7b_02
Mini · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
jondurbin_bagel-dpo-8x7b-v0.2
Bagel · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingRoleplay
CH
Chronohermes Grad L2 13B
Chronohermes · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
OP
opus v0.5 70B
Opus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
BA
jondurbin_bagel-34b-v0.2
Bagel · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
CodingRoleplay
CH
Chronos Beluga v2 13B
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SA
SauerkrautLM 70B v1
Sauerkrautlm · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing