GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
SM
rishiraj_smol-7b
Smol · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
LI
lince zero
Lince · TheBloke
Params7.22B
Context2K
Smallest4.2 GB
BR
ba2han_bruinsv2-ophermesneu-11b
Bruinsv · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
ME
MegaMix S1 13B
Megamix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ST
StableBeluga2 70B
Stablebeluga · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
smelborp_mixtralorochi8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
UT
Utopia 13B
Utopia · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
WI
wizardlm_wizardlm-13b-v1.1
Wizardlm · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
KO
maywell_koopenchat-sft
Koopenchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
TO
tora 70B v1.0
Tora · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GO
Goliath longLORA 120b rope8 32k fp16
Goliath · TheBloke
Params118B
Context4K
Smallest43.2 GB
SY
Synatra RP Orca 2 7B v0.1
Synatra · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
ME
mihaiii_metis-0.1
Metis · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
jondurbin_bagel-7b-v0.1
Bagel · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
SauerkrautLM 7B v1
Sauerkrautlm · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
AG
agiin 13.6B v0.1
Agiin · TheBloke
Params13.8B
Context4K
Q4_K_M8.3 GB
HU
huginnv1.2
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
YI
mncai_yi-34b-v3
Yi · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
MI
mncai_mistral-7b-dpo-v5
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openbuddy_openbuddy-mixtral-7bx8-v16.3-32k
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
UN
Unholy v1 10l 13B
Unholy · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GU
timdettmers_guanaco-7b
Guanaco · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
SU
janhq_supermario-v2
Supermario · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
Dawn v2 70B
Dawn · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
BI
undi95_bigplap-8x20b
Bigplap · TheBloke
Params112B
Context32K
Smallest39.4 GB
TO
tora 7B v1.0
Tora · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
SY
migtissera_synthia-7b-v1.2
Synthia · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
UT
UtopiaXL 13B
Utopiaxl · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
UN
Unholy v1 12L 13B
Unholy · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
VE
Venus 120b v1.2
Venus · TheBloke
Params120B
Context4K
Smallest44.0 GB