GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
MI
MistralMakise Merged 13B
Mistral · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AU
Augmental 13B v1.50 A
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CO
beowolx_codeninja-1.0-openchat-7b
Codeninja · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
WI
wizardlm_wizardcoder-33b-v1.1
Wizardcoder · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
AT
Athena v2
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SE
Sensualize Solar 10.7B
Sensualize · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
LLaMA 30b
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
TR
bluenipples_trion-m-7b
Trion · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
ES
EstopianMaid 13B
Estopianmaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
LLaMA Pro 8B
Llama · TheBloke
Params8.36B
Context4K
Q4_K_M5.1 GB
TE
Tess M Creative v1.0
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
SY
Synthia v3.0 11B
Synthia · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
TI
py007_tinyllama-1.1b-intermediate-step-715k-1.5t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
AI
jondurbin_airoboros-m-7b-3.1.1
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SW
Swallow 70B instruct
Swallow · TheBloke
Params69.2B
Context4K
Q4_K_M41.5 GB
LL
Upstage Llama1 65B Instruct
Llama · TheBloke
Params65B
Context2K
Q4_K_M39.3 GB
PR
prometheus 13B v1.0
Prometheus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AM
llm360_amber
Amber · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
NO
nousresearch_nous-hermes-13b
Nous · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
EU
Euryale 1.4 L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
CO
CodeUp Alpha 13B HF
Codeup · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
OR
Orca 2 13B
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
TI
py007_tinyllama-1.1b-python-v0.1
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
SY
Synthia 70B v1.2b
Synthia · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
FA
FashionGPT 70B V1.1
Fashiongpt · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
CA
camel-ai_camel-33b-combined-data
Camel · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
KA
keynote-technology_kai-7b-beta
Kai · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
py007_tinyllama-1.1b-intermediate-step-480k-1t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
PO
Poro 34B
Poro · TheBloke
Params35.1B
Context7K
Q4_K_M22.4 GB
MI
sciphi_sciphi-self-rag-mistral-7b-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB