GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MistralMakise Merged 13B
Mistral · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AU
Augmental 13B v1.50 A
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
beowolx_codeninja-1.0-openchat-7b
Codeninja · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
WI
wizardlm_wizardcoder-33b-v1.1
Wizardcoder · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
AT
Athena v2
Athena · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SE
Sensualize Solar 10.7B
Sensualize · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
LLaMA 30b
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
TR
bluenipples_trion-m-7b
Trion · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ES
EstopianMaid 13B
Estopianmaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
LL
LLaMA Pro 8B
Llama · TheBloke
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF
TE
Tess M Creative v1.0
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
SY
Synthia v3.0 11B
Synthia · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
TI
py007_tinyllama-1.1b-intermediate-step-715k-1.5t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
AI
jondurbin_airoboros-m-7b-3.1.1
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SW
Swallow 70B instruct
Swallow · TheBloke
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
LL
Upstage Llama1 65B Instruct
Llama · TheBloke
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
PR
prometheus 13B v1.0
Prometheus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AM
llm360_amber
Amber · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
NO
nousresearch_nous-hermes-13b
Nous · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Tool use
EU
Euryale 1.4 L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
CO
CodeUp Alpha 13B HF
Codeup · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
OR
Orca 2 13B
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TI
py007_tinyllama-1.1b-python-v0.1
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
SY
Synthia 70B v1.2b
Synthia · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
FA
FashionGPT 70B V1.1
Fashiongpt · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
CA
camel-ai_camel-33b-combined-data
Camel · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
KA
keynote-technology_kai-7b-beta
Kai · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
TI
py007_tinyllama-1.1b-intermediate-step-480k-1t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
PO
Poro 34B
Poro · TheBloke
Params35.1B
Context7K
Q4_K_M22.4 GB
Coding
MI
sciphi_sciphi-self-rag-mistral-7b-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing