GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
AI
Airoboros L2 70B 2.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
JA
stabilityai_japanese-stablelm-instruct-gamma-7b
Japanese · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
WH
whiterabbitneo_whiterabbitneo-33b-v1
Whiterabbitneo · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
NO
nousresearch_nous-capybara-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
DaringFortitude
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NO
Nous Puffin 70B
Nous · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
SO
SOLAR 10.7B Instruct v1.0 uncensored
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
YI
01-ai_yi-6b-200k
Yi · TheBloke
Params6.06B
Context195K
Q4_K_M3.7 GB
LL
phind_phind-codellama-34b-v2
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
LL
nousresearch_yarn-llama-2-13b-128k
Llama · TheBloke
Params13B
Context128K
Q4_K_M7.9 GB
LL
nousresearch_yarn-llama-2-13b-64k
Llama · TheBloke
Params13B
Context64K
Q4_K_M7.9 GB
PY
ajibawa-2023_python-code-33b
Python · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
LO
LoKuS 13B
Lokus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
argilla_capybarahermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
causallm_14b
TheBloke
Params14.2B
Context8K
Smallest8.2 GB
NO
nousresearch_nous-capybara-7b-v1.9
Nous · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
codellama_codellama-13b-hf
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
NO
Nous Hermes 2 SOLAR 10.7B
Nous · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Speechless Llama2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
ehartford_dolphin-2.0-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
brucethemoose_capytessborosyi-34b-200k-dare-ties
Capytessborosyi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
codellama_codellama-7b-python-hf
Llama · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
DI
discoresearch_discolm_german_7b_v1
Discolm · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
phind_phind-codellama-34b-python-v1
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
PH
dolphin 2 6 phi 2
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
LL
CodeLlama 70B Python
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
UN
Uncensored Jordan 13B
Uncensored · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CH
Chronos Hermes 13b v2
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
UN
ajibawa-2023_uncensored-jordan-33b
Uncensored · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB