GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
DA
pocketdoc_dans-adventurouswinds-mk2-7b
Dans · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
nurtureai_openhermes-2.5-mistral-7b-16k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CL
claude2 alpaca 13B
Claude · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
ehartford_samantha-1.2-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
sciphi_sensei-7b-v1
Sensei · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
teknium_collectivecognition-v1.1-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
TU
Tulpar 7B v0
Tulpar · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
WI
WizardLM 13B V1.2
Wizardlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
DE
deepseek llm 7B base
DeepSeek · TheBloke
Params6.91B
Context4K
Q4_K_M4.2 GB
OP
OpenOrca Platypus2 13B
Openorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
YO
You can cry Snowman 13B
You · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
SL
SlimOrca 13B
Slimorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LE
ignos_leoscorpius-greennode-platypus-7b-v1
Leoscorpius · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
q-bert_optimus-7b
Optimus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
neversleep_noromaid-v0.4-mixtral-instruct-8x7b-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
nruaif_kimiko-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
uukuguy_speechless-mistral-dolphin-orca-platypus-samantha-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
teknium_mistral-trismegistus-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Airolima Chronos Grad L2 13B
Airolima · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
RP
rpguild chatml 13B
Rpguild · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ME
merlyn education corpus qa v2
Merlyn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
janhq_mistral-7b-instruct-v0.2-dare
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SW
Swallow 7B
Swallow · TheBloke
Params6.83B
Context4K
Q4_K_M4.1 GB
YI
Yi 34B Chat
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
OP
weyaxi_openhermes-2.5-neural-chat-v3-3-slerp
Openhermes · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Nous Capybara 7B
Nous · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MA
tiger-lab_mammoth-coder-34b
Mammoth · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
TY
scb10x_typhoon-7b
Typhoon · TheBloke
Params7.27B
Context32K
Q4_K_M4.4 GB
KI
Kimiko v2 13B
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AI
jondurbin_airoboros-c34b-2.2.1
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB