GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo-laser
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LE
Lemur 70B Chat v1
Lemur · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
togethercomputer_llama-2-7b-32k-instruct
Llama · TheBloke
Params6.74B
Context32K
Q4_K_M4.1 GB
ME
q-bert_metamath-cybertron-starling
Metamath · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
ehartford_wizard-vicuna-30b-uncensored
Wizard · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
LL
openassistant_llama2-13b-orca-8k-3319
Llama · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
LL
ehartford_samantha-1.11-codellama-34b
Llama · TheBloke
Params33.7B
Context2K
Q4_K_M20.2 GB
JA
japanese stablelm instruct beta 70B
Japanese · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
PY
Python Code 13B
Python · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 2 Coder 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
AI
jondurbin_airoboros-m-7b-3.1
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MY
MythoLogic Mini 7B
Mythologic · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
AI
Airoboros L2 70B 3.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
SA
SauerkrautLM UNA SOLAR Instruct
Sauerkrautlm · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
NO
argilla_notus-7b-v1
Notus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
01-ai_yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
WI
monero_wizardlm-uncensored-supercot-storytelling-30b
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
KU
sanjiwatsuki_kunoichi-7b
Kunoichi · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
MY
Mythalion 13B
Mythalion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AI
Airoboros L2 70B 2.1 Creative
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
norquinal_mistral-7b-claude-chat
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
undi95_mixtral-8x7b-moe-rp-story
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GU
Guanaco 13B Uncensored
Guanaco · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
OP
openchat_openchat_3.5
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Nous Hermes Llama2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
jphme_em_german_leo_mistral
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AS
asclepius-13b
Asclepius · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
OP
openchat_openchat-3.5-0106
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
NE
Nethena 13B
Nethena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
paixai_astrid-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB