GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
CH
Chinese Alpaca 2 7B
Chinese · TheBloke
Params6.93B
Context4K
Q4_K_M4.2 GB
ZE
qblocks_zephyr_7b_norobots
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AU
Aurora Nights 103B v1.0
Aurora · TheBloke
Params103B
Context4K
Smallest43.5 GB
NA
Nanbeige 16B Chat 32K
Nanbeige · TheBloke
Params15.8B
Context4K
Q4_K_M9.6 GB
KA
fpham_karen_theeditor_13b_hf
Karen · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
AI
Airoboros L2 70b 2.2.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
VI
felixchao_vicuna-33b-coder
Vicuna · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
BA
openerotica_basilisk-7b-v0.2
Basilisk · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Nethena MLewd Xwin 23B
Nethena · TheBloke
Params22.8B
Context4K
Q4_K_M13.8 GB
TI
tigerresearch_tigerbot-70b-chat
Tigerbot · TheBloke
Params69.4B
Context2K
Q4_K_M41.7 GB
PH
phi 2 dpo
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
CO
ajibawa-2023_code-33b
Code · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
BA
ehartford_based-30b
Based · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
SA
maritaca-ai_sabia-7b
Sabia · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
mikael110_llama-2-70b-guanaco-qlora
Llama · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
PA
pipizhao_pandalyst-7b-v1.2
Pandalyst · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
LE
Lewd Sydney 20B
Lewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
UN
Unholy v2 13B
Unholy · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AP
AppleSauce L2 13B
Applesauce · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
fpham_karen_theeditor_v2_strict_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
EU
euclaise_ferret_7b
Euclaise · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
MergeMonster 13B 20231124
Mergemonster · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
LLaMA2 13B TiefighterLR
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
adonlee_llama_2_13b_sft_v1
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LA
calderaai_30b-lazarus
Lazarus · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
NE
Nete 13B
Nete · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
VI
lmsys_vicuna-33b-v1.3
Vicuna · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
BL
calderaai_13b-bluemethod
Bluemethod · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
NU
nurtureai_openchat_3.5-16k
Nurtureai · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
superagi_sam
Sam · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB