GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
Chinese Alpaca 2 7B
Chinese · TheBloke
Params6.93B
Context4K
Q4_K_M4.2 GB
GGUF
ZE
qblocks_zephyr_7b_norobots
Zephyr · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
AU
Aurora Nights 103B v1.0
Aurora · TheBloke
Params103B
Context4K
Smallest43.5 GB
GGUF
NA
Nanbeige 16B Chat 32K
Nanbeige · TheBloke
Params15.8B
Context4K
Q4_K_M9.6 GB
Coding
KA
fpham_karen_theeditor_13b_hf
Karen · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
AI
Airoboros L2 70b 2.2.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
VI
felixchao_vicuna-33b-coder
Vicuna · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
Coding
BA
openerotica_basilisk-7b-v0.2
Basilisk · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Nethena MLewd Xwin 23B
Nethena · TheBloke
Params22.8B
Context4K
Q4_K_M13.8 GB
GGUF
TI
tigerresearch_tigerbot-70b-chat
Tigerbot · TheBloke
Params69.4B
Context2K
Q4_K_M41.7 GB
GGUF
PH
phi 2 dpo
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
Coding
CO
ajibawa-2023_code-33b
Code · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
Coding
BA
ehartford_based-30b
Based · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
SA
maritaca-ai_sabia-7b
Sabia · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
mikael110_llama-2-70b-guanaco-qlora
Llama · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
PA
pipizhao_pandalyst-7b-v1.2
Pandalyst · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LE
Lewd Sydney 20B
Lewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
UN
Unholy v2 13B
Unholy · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AP
AppleSauce L2 13B
Applesauce · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
fpham_karen_theeditor_v2_strict_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EU
euclaise_ferret_7b
Euclaise · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
MergeMonster 13B 20231124
Mergemonster · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
LLaMA2 13B TiefighterLR
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
adonlee_llama_2_13b_sft_v1
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LA
calderaai_30b-lazarus
Lazarus · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
NE
Nete 13B
Nete · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
lmsys_vicuna-33b-v1.3
Vicuna · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
BL
calderaai_13b-bluemethod
Bluemethod · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NU
nurtureai_openchat_3.5-16k
Nurtureai · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
superagi_sam
Sam · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing