GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
TU
allenai_tulu-13b
Tulu · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
NE
sanjiwatsuki_neural-chat-7b-v3-3-wizardmath-dare-me
Neural · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
BE
BerrySauce L2 13B
Berrysauce · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GR
greennode_greennodelm-7b-v4leo
Greennodelm · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
weyaxi_openorca-zephyr-7b
Openorca · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NU
nurtureai_synthia-7b-v2.0-16k
Nurtureai · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StableBeluga 7B
Stablebeluga · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
TI
gryphe_tiamat-7b
Tiamat · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
FL
undi95_flatdolphinmaid-8x7b
Flatdolphinmaid · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
NO
X NoroChronos 13B
Norochronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ZE
royallab_zephrp-m7b
Zephrp · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
VE
delcos_velara
Velara · TheBloke
Params11.4B
Context32K
Q4_K_M6.8 GB
LL
llemma 34b
Llemma · TheBloke
Params33.7B
Context4K
Q4_K_M20.2 GB
TU
allenai_tulu-2-13b
Tulu · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
BR
rwitz2_go-bruins-v2.1.1
Bruins · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ZA
Zarablend L2 7B
Zarablend · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
SA
Samantha 1.1 70B
Samantha · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
HU
Huginn v3 13B
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
YI
platypus yi 34b
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
ME
MegaMix T1 13B
Megamix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GO
goliath 120b
Goliath · TheBloke
Params118B
Context4K
Smallest49.6 GB
BA
jondurbin_bagel-8x7b-v0.2
Bagel · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
LL
Llama2 22B GPLATTY
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
MI
minirecord_mini_synatra_7b_02
Mini · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
jondurbin_bagel-dpo-8x7b-v0.2
Bagel · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
CH
Chronohermes Grad L2 13B
Chronohermes · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
OP
opus v0.5 70B
Opus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
BA
jondurbin_bagel-34b-v0.2
Bagel · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
CH
Chronos Beluga v2 13B
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SA
SauerkrautLM 70B v1
Sauerkrautlm · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB