GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
CA
cat v1.0 13B
Cat · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 2 13B Ensemble v5
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
mmnga_mixtral-fusion-4x7b-instruct-v0.1
Mistral · TheBloke
Params24.2B
Context32K
Q4_K_M13.6 GB
LL
ausboss_llama-13b-supercot
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
TH
13B Thorns L2
Thorns · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
KA
Kaori 70B v1
Kaori · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MY
gryphe_mythoboros-13b
Mythoboros · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
OP
OpenCAI 13B
Opencai · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 2 7B ft instruct es
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
AG
agentlm 70B
Agentlm · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
undi95_mistrp-airoboros-7b
Mistrp · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 2 70B LoRA Assemble v2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
RO
Rogue Rose 103b v0.2
Rogue · TheBloke
Params103B
Context4K
Smallest43.5 GB
MY
gryphe_mythologic-13b
Mythologic · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
KI
Kimiko 13B
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
llama2 7B layla
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LE
leolm_leo-hessianai-13b
Leo · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
AJ
ajibawa-2023_uncensored-frank-33b
Ajibawa · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
AL
AlpacaCielo 13B
Alpacacielo · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LO
chargoddard_loyal-piano-m7
Loyal · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
conceptofmind_hermes-llongma-2-7b-8k
Hermes · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
XW
Xwin LM 13B V0.1
Xwin · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
UN
UndiMix v1 13B
Undimix · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama2 chat AYB 13B
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
WI
wizardlm_wizardlm-30b-v1.0
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
ME
MetaMath 13B V1.0
Metamath · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
OP
norquinal_opencai-7b
Opencai · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
DY
DynamicFactor
Dynamicfactor · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TU
allenai_tulu-2-70b
Tulu · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
RO
jeiku_rosa_v2_7b
Rosa · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB