GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
PE
perlthoughts_falkor-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
VI
bofenghuang_vigostral-7b-chat
Vigostral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
LLaMA2 13B Psyfighter2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AI
airoboros l2 7B gpt4 m2.0
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
vagosolutions_sauerkrautlm-7b-v1-mistral
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
mihaiii_metis-0.3
Metis · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
emrgnt-cmplxty_mistral-7b-sciphi-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Nous Hermes 2 SUS Chat 34B Slerp
Nous · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
ME
adaptllm_medicine-llm-13b
Medicine · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
FI
finance chat
Finance · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
sao10k_sensualize-mixtral-bf16
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MO
model 007 70B
Model · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
YI
dragon yi 6B v0
Yi · TheBloke
Params6.06B
Context4K
Q4_K_M3.7 GB
XW
Xwin MLewd 13B v0.2
Xwin · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AU
Augmental 13B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MA
Marx 3B v3
Marx · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
MI
ehartford_samantha-mistral-instruct-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama polyglot 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
ORCA LLaMA 70B QLoRA
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
YI
brucethemoose_yi-34b-200k-dare-merge-v5
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
PA
mihaiii_pallas-0.3
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
TU
allenai_tulu-2-dpo-70b
Tulu · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
SY
maywell_synatra-7b-v0.3-dpo
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NA
Nanbeige 16B Base 32K
Nanbeige · TheBloke
Params15.8B
Context4K
Q4_K_M9.6 GB
SQ
defog_sqlcoder-34b-alpha
Sqlcoder · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
ST
storytime 13B
Storytime · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
EC
Echidna 13B v0.3
Echidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
VI
neko-institute-of-science_vicunlocked-30b-lora
Vicunlocked · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
SI
sanjiwatsuki_silicon-maid-7b
Silicon · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Chinese Llama 2 7B
Llama · TheBloke
Params6.93B
Context4K
Q4_K_M4.2 GB