GGUF models by TheBloke

1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.

Most downloadedNewestLargestLongest contextSmallest
ET
steelskull_etheria-55b-v0.1
Etheria · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
GGUF
ML
MLewd ReMM L2 Chat 20B
Mlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
OR
ddh0_orcamaid-v3-13b-32k
Orcamaid · TheBloke
Params13B
Context32K
Q4_K_M7.9 GB
GGUF
AI
airoboros l2 13B 3.0
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
firefly llama2 7B chat
Llama · TheBloke
Params6.93B
Context4K
Q4_K_M4.2 GB
GGUF
XW
Xwin MLewd 7B V0.2
Xwin · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
speechlessai_speechless-mistral-7b-dare-0.85
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SP
Spicyboros 7B 2.2
Spicyboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
undi95_mistral-claudelimarp-v3-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NY
beberik_nyxene-v3-11b
Nyxene · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
aloobun_bun_mistral_7b_v2
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HU
Huginn 22B Prototype
Huginn · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
LL
larryvrh_yi-34b-200k-llamafied
Llama · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
TH
Thespis 13B v0.4
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CH
henk717_chronoboros-33b
Chronoboros · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
SP
Spicyboros 70B 2.2
Spicyboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DI
digital socrates 13B
Digital · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MA
Marcoroni 13B
Marcoroni · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
VI
lmsys_vicuna-7b-v1.5-16k
Vicuna · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
CA
cyberagent_calm2-7b-chat
Calm · TheBloke
Params7.01B
Context32K
Q4_K_M4.3 GB
GGUF
LL
OpenBuddy Llama2 70b v10.1
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
GGUF
MI
chargoddard_mixtralnt-4x7b-test
Mistral · TheBloke
Params24.2B
Context32K
Q4_K_M13.6 GB
GGUF
AI
airoboros l2 70B gpt4 1.4.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
OP
sanjiwatsuki_openchat-3.5-1210-starling-slerp
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
AL
ALMA 7B
Alma · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LE
ignos_leoscorpius-greennode-alpaca-7b-v1
Leoscorpius · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UN
ajibawa-2023_uncensored-frank-7b
Uncensored · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
maywell_pivot-10.7b-mistral-v0.2
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LL
firefly llama2 13B chat
Llama · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
PE
perlthoughts_starling-lm-alpha-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF

Keep browsing