GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
AI
Airoboros L2 70B 2.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
JA
stabilityai_japanese-stablelm-instruct-gamma-7b
Japanese · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WH
whiterabbitneo_whiterabbitneo-33b-v1
Whiterabbitneo · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
GGUF
NO
nousresearch_nous-capybara-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
DaringFortitude
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NO
Nous Puffin 70B
Nous · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0 uncensored
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
YI
01-ai_yi-6b-200k
Yi · TheBloke
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
LL
phind_phind-codellama-34b-v2
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
LL
nousresearch_yarn-llama-2-13b-128k
Llama · TheBloke
Params13B
Context128K
Q4_K_M7.9 GB
GGUF
LL
nousresearch_yarn-llama-2-13b-64k
Llama · TheBloke
Params13B
Context64K
Q4_K_M7.9 GB
GGUF
PY
ajibawa-2023_python-code-33b
Python · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
Coding
LO
LoKuS 13B
Lokus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
argilla_capybarahermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
CA
causallm_14b
TheBloke
Params14.2B
Context8K
Smallest8.2 GB
Tool useVision
NO
nousresearch_nous-capybara-7b-v1.9
Nous · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
codellama_codellama-13b-hf
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
NO
Nous Hermes 2 SOLAR 10.7B
Nous · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
Tool use
LL
Speechless Llama2 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
ehartford_dolphin-2.0-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
brucethemoose_capytessborosyi-34b-200k-dare-ties
Capytessborosyi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
codellama_codellama-7b-python-hf
Llama · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DI
discoresearch_discolm_german_7b_v1
Discolm · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
phind_phind-codellama-34b-python-v1
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
PH
dolphin 2 6 phi 2
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
CodingTool use
LL
CodeLlama 70B Python
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
UN
Uncensored Jordan 13B
Uncensored · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
Chronos Hermes 13b v2
Chronos · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
UN
ajibawa-2023_uncensored-jordan-33b
Uncensored · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF

Keep browsing