GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
openbuddy_openbuddy-mixtral-8x7b-v15.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
GGUF
LL
Llama 2 7B vietnamese 20k
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
OrionStar Yi 34B Chat Llama
Llama · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
DA
DaringMaid 13B
Daringmaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
chargoddard_mixtralrpchat-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
ME
medicine chat
Medicine · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LA
adaptllm_law-llm-13b
Law · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
FI
adaptllm_finance-llm
Finance · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
teknium_collectivecognition-v1-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CI
jondurbin_cinematika-7b-v0.1
Cinematika · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
elinas_chronos-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
TE
migtissera_tess-34b-v1.5b
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
TE
migtissera_tess-xs-v1.1
Tess · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
tigerresearch_tigerbot-70b-chat-v2
Tigerbot · TheBloke
Params69.4B
Context2K
Q4_K_M41.7 GB
GGUF
SY
migtissera_synthia-70b-v1.5
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
YU
yulan-team_yulan-chat-2-13b-fp16
Yulan · TheBloke
Params13.2B
Context8K
Q4_K_M8.0 GB
GGUF
LL
llama 2 13B Guanaco QLoRA
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
OP
allenai_open-instruct-human-mix-65b
Open · TheBloke
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
MI
nousresearch_nous-hermes-2-mixtral-8x7b-sft
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
EV
rombodawg_everyone-coder-4x7b-base
Everyone · TheBloke
Params24.2B
Context32K
Q4_K_M14.6 GB
Coding
DE
Deacon 34B
Deacon · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
AG
agentlm 7B
Agentlm · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ME
medalpaca_medalpaca-13b
Medalpaca · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
PI
maywell_pivot-0.1-starling-lm-rp
Pivot · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
Roleplay
AL
alfred 40B 1023
Alfred · TheBloke
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
FA
FashionGPT 70B v1.2
Fashiongpt · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LA
adaptllm_law-llm
Law · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
BL
bling stable lm 3b 4e1t v0
Bling · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
GO
GOAT 70B Storytelling
Goat · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PY
Pygmalion 2 13B SuperCOT2
Pygmalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing