GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
YI
brucethemoose_capybara-tess-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
DA
DaringMaid 20B
Daringmaid · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
AU
Augmental Unholy 13B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
ausboss_llama-30b-supercot
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
DA
pocketdoc_dans-totsirocco-7b
Dans · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LU
LUNA SOLARkrautLM Instruct
Luna · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
MistralLite 7B
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
weyaxi_openhermes-2.5-neural-chat-7b-v3-2-7b
Openhermes · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
JA
japanese stablelm base beta 70B
Japanese · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
NE
mlabonne_neuralpipe-7b-slerp
Neuralpipe · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SY
maywell_synatra-v0.1-7b-instruct
Synatra · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
nickynicky_mistral-7b-openorca-oasst_top1_2023-08-25-v2
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 34B
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
SA
vagosolutions_sauerkrautlm-solar-instruct
Sauerkrautlm · TheBloke
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
RO
Rose 20B
Rose · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
CO
oobabooga_codebooga-34b-v0.1
Codebooga · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
OR
ddh0_orcamaid-v2-fix-13b-32k
Orcamaid · TheBloke
Params13B
Context32K
Q4_K_M7.9 GB
GGUF
SA
SauerkrautLM 13B v1
Sauerkrautlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TR
Trurl 2 7B
Trurl · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TO
llm-agents_tora-code-34b-v1.0
Tora · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
llama2 7b chat codeCherryPop qLoRA
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SW
Swallow 13B
Swallow · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
SO
SOLAR 10.7B v1.0
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
adamo1139_mistral-7b-aezakmi-v1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
cloudyu_mixtral_34bx2_moe_60b
Mistral · TheBloke
Params60.8B
Context195K
Q4_K_M34.4 GB
GGUF
VI
vicuna 7B v1.5
Vicuna · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
weyaxi_openhermes-2.5-neural-chat-7b-v3-1-7b
Openhermes · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LE
leolm_leo-hessianai-7b-chat
Leo · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
TE
migtissera_tess-m-v1.3
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
CH
Chronomaid Storytelling 13B
Chronomaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing