GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
DA
pocketdoc_dans-adventurouswinds-mk2-7b
Dans · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
nurtureai_openhermes-2.5-mistral-7b-16k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
CL
claude2 alpaca 13B
Claude · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
ehartford_samantha-1.2-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SE
sciphi_sensei-7b-v1
Sensei · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
teknium_collectivecognition-v1.1-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TU
Tulpar 7B v0
Tulpar · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
WI
WizardLM 13B V1.2
Wizardlm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DE
deepseek llm 7B base
DeepSeek · TheBloke
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
OP
OpenOrca Platypus2 13B
Openorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
YO
You can cry Snowman 13B
You · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
SL
SlimOrca 13B
Slimorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
ignos_leoscorpius-greennode-platypus-7b-v1
Leoscorpius · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
q-bert_optimus-7b
Optimus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
neversleep_noromaid-v0.4-mixtral-instruct-8x7b-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
nruaif_kimiko-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
uukuguy_speechless-mistral-dolphin-orca-platypus-samantha-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
teknium_mistral-trismegistus-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Airolima Chronos Grad L2 13B
Airolima · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RP
rpguild chatml 13B
Rpguild · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
ME
merlyn education corpus qa v2
Merlyn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
janhq_mistral-7b-instruct-v0.2-dare
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SW
Swallow 7B
Swallow · TheBloke
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF
YI
Yi 34B Chat
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
OP
weyaxi_openhermes-2.5-neural-chat-v3-3-slerp
Openhermes · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
NO
Nous Capybara 7B
Nous · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MA
tiger-lab_mammoth-coder-34b
Mammoth · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
TY
scb10x_typhoon-7b
Typhoon · TheBloke
Params7.27B
Context32K
Q4_K_M4.4 GB
GGUF
KI
Kimiko v2 13B
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AI
jondurbin_airoboros-c34b-2.2.1
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF

Keep browsing