GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
SM
rishiraj_smol-7b
Smol · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LI
lince zero
Lince · TheBloke
Params7.22B
Context2K
Smallest4.2 GB
GGUF
BR
ba2han_bruinsv2-ophermesneu-11b
Bruinsv · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
Tool use
ME
MegaMix S1 13B
Megamix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
StableBeluga2 70B
Stablebeluga · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
smelborp_mixtralorochi8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
UT
Utopia 13B
Utopia · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
wizardlm_wizardlm-13b-v1.1
Wizardlm · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
KO
maywell_koopenchat-sft
Koopenchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
TO
tora 70B v1.0
Tora · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
GO
Goliath longLORA 120b rope8 32k fp16
Goliath · TheBloke
Params118B
Context4K
Smallest43.2 GB
GGUF
SY
Synatra RP Orca 2 7B v0.1
Synatra · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Roleplay
ME
mihaiii_metis-0.1
Metis · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
jondurbin_bagel-7b-v0.1
Bagel · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
SA
SauerkrautLM 7B v1
Sauerkrautlm · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AG
agiin 13.6B v0.1
Agiin · TheBloke
Params13.8B
Context4K
Q4_K_M8.3 GB
GGUF
HU
huginnv1.2
Huginn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
YI
mncai_yi-34b-v3
Yi · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
GGUF
MI
mncai_mistral-7b-dpo-v5
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openbuddy_openbuddy-mixtral-7bx8-v16.3-32k
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
GGUF
UN
Unholy v1 10l 13B
Unholy · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GU
timdettmers_guanaco-7b
Guanaco · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SU
janhq_supermario-v2
Supermario · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
Dawn v2 70B
Dawn · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
BI
undi95_bigplap-8x20b
Bigplap · TheBloke
Params112B
Context32K
Smallest39.4 GB
GGUF
TO
tora 7B v1.0
Tora · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
SY
migtissera_synthia-7b-v1.2
Synthia · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
UT
UtopiaXL 13B
Utopiaxl · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
UN
Unholy v1 12L 13B
Unholy · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VE
Venus 120b v1.2
Venus · TheBloke
Params120B
Context4K
Smallest44.0 GB
GGUF

Keep browsing