GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
MI
openbuddy_openbuddy-mixtral-8x7b-v15.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
LL
Llama 2 7B vietnamese 20k
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
OrionStar Yi 34B Chat Llama
Llama · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
DA
DaringMaid 13B
Daringmaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
chargoddard_mixtralrpchat-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
ME
medicine chat
Medicine · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LA
adaptllm_law-llm-13b
Law · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
FI
adaptllm_finance-llm
Finance · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
teknium_collectivecognition-v1-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CI
jondurbin_cinematika-7b-v0.1
Cinematika · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
elinas_chronos-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
TE
migtissera_tess-34b-v1.5b
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
TE
migtissera_tess-xs-v1.1
Tess · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
tigerresearch_tigerbot-70b-chat-v2
Tigerbot · TheBloke
Params69.4B
Context2K
Q4_K_M41.7 GB
SY
migtissera_synthia-70b-v1.5
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
YU
yulan-team_yulan-chat-2-13b-fp16
Yulan · TheBloke
Params13.2B
Context8K
Q4_K_M8.0 GB
LL
llama 2 13B Guanaco QLoRA
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
OP
allenai_open-instruct-human-mix-65b
Open · TheBloke
Params65B
Context2K
Q4_K_M39.3 GB
MI
nousresearch_nous-hermes-2-mixtral-8x7b-sft
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
EV
rombodawg_everyone-coder-4x7b-base
Everyone · TheBloke
Params24.2B
Context32K
Q4_K_M14.6 GB
DE
Deacon 34B
Deacon · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
AG
agentlm 7B
Agentlm · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
ME
medalpaca_medalpaca-13b
Medalpaca · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
PI
maywell_pivot-0.1-starling-lm-rp
Pivot · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
AL
alfred 40B 1023
Alfred · TheBloke
Params41.8B
Context2K
Q4_K_M25.5 GB
FA
FashionGPT 70B v1.2
Fashiongpt · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LA
adaptllm_law-llm
Law · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
BL
bling stable lm 3b 4e1t v0
Bling · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GO
GOAT 70B Storytelling
Goat · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
PY
Pygmalion 2 13B SuperCOT2
Pygmalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB