GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
WI
WinterGoddess 1.4x 70B L2
Wintergoddess · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
ST
stockmark_stockmark-13b
Stockmark · TheBloke
Params13.2B
Context2K
Q4_K_M8.0 GB
LL
llemma 7b
Llemma · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
VI
kevinpro_vicuna-13b-cot
Vicuna · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
TE
migtissera_tess-7b-v1.4
Tess · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
jondurbin_bagel-dpo-34b-v0.2
Bagel · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GE
genz 13B v2
Genz · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
VI
Vigogne 2 7B Chat
Vigogne · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
TU
allenai_tulu-7b
Tulu · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
SY
uukuguy_synthia-7b-v1.3-dare-0.85
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
Kuchiki L2 7B
Kuchiki · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
uukuguy_collectivecognition-v1.1-mistral-7b-dare-0.85
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
nondzu_zephyr-7b-beta-pl
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
VA
cookinai_valkyrie-v1
Valkyrie · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
rwitz2_pee
Mergemix · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
toten5_marcoroni-neural-chat-7b-v1
Marcoroni · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
vagosolutions_sauerkrautlm-3b-v1
Sauerkrautlm · TheBloke
Params3.43B
Context2K
Smallest2.0 GB
RE
ReMM v2.1 L2 13B
Remm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
cgato_thespis-mistral-7b-v0.6
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
em german 7b v01
German · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
ST
Stheno v2 Delta
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GA
Gale medium init 3B
Gale · TheBloke
Params3.1B
Context32K
Q4_K_M1.9 GB
SY
Synthia 13B v1.2
Synthia · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LI
Lila 70B L2
Lila · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
WI
openaccess-ai-collective_wizard-mega-13b
Wizard · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
WI
wizardlm_wizardlm-7b-v1.0
Wizardlm · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
EM
Emerhyst 13B
Emerhyst · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CH
Chronolima Airo Grad L2 13B
Chronolima · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Sheep Duck Llama 2 70B
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
TH
Thespis 13B DPO v0.7
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB