GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
PE
perlthoughts_falkor-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
VI
bofenghuang_vigostral-7b-chat
Vigostral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
LLaMA2 13B Psyfighter2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
airoboros l2 7B gpt4 m2.0
Airoboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
vagosolutions_sauerkrautlm-7b-v1-mistral
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
mihaiii_metis-0.3
Metis · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
emrgnt-cmplxty_mistral-7b-sciphi-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Nous Hermes 2 SUS Chat 34B Slerp
Nous · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
ME
adaptllm_medicine-llm-13b
Medicine · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
FI
finance chat
Finance · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
sao10k_sensualize-mixtral-bf16
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MO
model 007 70B
Model · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
YI
dragon yi 6B v0
Yi · TheBloke
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
XW
Xwin MLewd 13B v0.2
Xwin · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AU
Augmental 13B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MA
Marx 3B v3
Marx · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
MI
ehartford_samantha-mistral-instruct-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama polyglot 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ORCA LLaMA 70B QLoRA
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
YI
brucethemoose_yi-34b-200k-dare-merge-v5
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
PA
mihaiii_pallas-0.3
Pallas · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
TU
allenai_tulu-2-dpo-70b
Tulu · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
SY
maywell_synatra-7b-v0.3-dpo
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NA
Nanbeige 16B Base 32K
Nanbeige · TheBloke
Params15.8B
Context4K
Q4_K_M9.6 GB
Coding
SQ
defog_sqlcoder-34b-alpha
Sqlcoder · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
ST
storytime 13B
Storytime · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
EC
Echidna 13B v0.3
Echidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
neko-institute-of-science_vicunlocked-30b-lora
Vicunlocked · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
SI
sanjiwatsuki_silicon-maid-7b
Silicon · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Chinese Llama 2 7B
Llama · TheBloke
Params6.93B
Context4K
Q4_K_M4.2 GB
GGUF

Keep browsing