GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
MI
lemonilia_ashhlimarp-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama 2 13B chat limarp v2 merged
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ST
stablelm zephyr 3b
Stablelm · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
LL
meta-llama-7b
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Chinese Llama 2 13B
Llama · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
TE
q-bert_terminis-7b
Terminis · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
EV
rombodawg_everyone-coder-33b-base
Everyone · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
EU
Euryale 1.3 L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
monology_openinstruct-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
airoboros l2 13B gpt4 1.4.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AT
Athena v4
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
llama 2 7B Guanaco QLoRA
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
OR
Orca 2 7B
Orca · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
WI
ehartford_wizardlm-13b-uncensored
Wizardlm · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
AI
Airoboros L2 70B 3.1.2
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
danielbrdz_barcenas-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
wizardlm_wizardcoder-python-7b-v1.0
Wizardlm · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
teknium_hermes-trismegistus-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
fpham_generate_question_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NA
calderaai_naberius-7b
Naberius · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
HO
HornyEchidna 13B v0.1
Hornyechidna · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SO
SOLAR Platypus 10.7B v2
Solar · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
AU
Augmental ReMM 13B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
uukuguy_speechless-code-mistral-7b-v1.0
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
openaccess-ai-collective_manticore-13b
Manticore · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
PI
maywell_pivot-sus-rp
Pivot · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
ZI
idea-ccnl_ziya-coding-34b-v1.0
Ziya · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
AI
bhenrym14_airoboros-l2-13b-2.1-yarn-64k
Airoboros · TheBloke
Params13B
Context64K
Q4_K_M7.9 GB
EH
ehartford_wizardlm-33b-v1.0-uncensored
Ehartford · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
CH
Chronos 70B v2
Chronos · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB