GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
CA
cat v1.0 13B
Cat · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 13B Ensemble v5
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
mmnga_mixtral-fusion-4x7b-instruct-v0.1
Mistral · TheBloke
Params24.2B
Context32K
Q4_K_M13.6 GB
GGUF
LL
ausboss_llama-13b-supercot
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
TH
13B Thorns L2
Thorns · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KA
Kaori 70B v1
Kaori · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MY
gryphe_mythoboros-13b
Mythoboros · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
OP
OpenCAI 13B
Opencai · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 2 7B ft instruct es
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AG
agentlm 70B
Agentlm · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
undi95_mistrp-airoboros-7b
Mistrp · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 2 70B LoRA Assemble v2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
RO
Rogue Rose 103b v0.2
Rogue · TheBloke
Params103B
Context4K
Smallest43.5 GB
GGUF
MY
gryphe_mythologic-13b
Mythologic · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
KI
Kimiko 13B
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
llama2 7B layla
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LE
leolm_leo-hessianai-13b
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
AJ
ajibawa-2023_uncensored-frank-33b
Ajibawa · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
AL
AlpacaCielo 13B
Alpacacielo · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LO
chargoddard_loyal-piano-m7
Loyal · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
conceptofmind_hermes-llongma-2-7b-8k
Hermes · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
Tool use
XW
Xwin LM 13B V0.1
Xwin · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
UN
UndiMix v1 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama2 chat AYB 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
wizardlm_wizardlm-30b-v1.0
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
ME
MetaMath 13B V1.0
Metamath · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
norquinal_opencai-7b
Opencai · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DY
DynamicFactor
Dynamicfactor · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TU
allenai_tulu-2-70b
Tulu · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
RO
jeiku_rosa_v2_7b
Rosa · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing