GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
WinterGoddess 1.4x 70B L2
Wintergoddess · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ST
stockmark_stockmark-13b
Stockmark · TheBloke
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
LL
llemma 7b
Llemma · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
Reasoning
VI
kevinpro_vicuna-13b-cot
Vicuna · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
TE
migtissera_tess-7b-v1.4
Tess · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
jondurbin_bagel-dpo-34b-v0.2
Bagel · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
CodingRoleplay
GE
genz 13B v2
Genz · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
Vigogne 2 7B Chat
Vigogne · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TU
allenai_tulu-7b
Tulu · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SY
uukuguy_synthia-7b-v1.3-dare-0.85
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KU
Kuchiki L2 7B
Kuchiki · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
uukuguy_collectivecognition-v1.1-mistral-7b-dare-0.85
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
nondzu_zephyr-7b-beta-pl
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VA
cookinai_valkyrie-v1
Valkyrie · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
rwitz2_pee
Mergemix · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
toten5_marcoroni-neural-chat-7b-v1
Marcoroni · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
vagosolutions_sauerkrautlm-3b-v1
Sauerkrautlm · TheBloke
Params3.43B
Context2K
Smallest2.0 GB
GGUF
RE
ReMM v2.1 L2 13B
Remm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
cgato_thespis-mistral-7b-v0.6
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
em german 7b v01
German · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ST
Stheno v2 Delta
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GA
Gale medium init 3B
Gale · TheBloke
Params3.1B
Context32K
Q4_K_M1.9 GB
GGUF
SY
Synthia 13B v1.2
Synthia · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LI
Lila 70B L2
Lila · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
WI
openaccess-ai-collective_wizard-mega-13b
Wizard · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
WI
wizardlm_wizardlm-7b-v1.0
Wizardlm · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
EM
Emerhyst 13B
Emerhyst · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
Chronolima Airo Grad L2 13B
Chronolima · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Sheep Duck Llama 2 70B
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
TH
Thespis 13B DPO v0.7
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing