GGUF models by TheBloke
1062 GGUF models quantized by TheBloke on Hugging Face. Sizes run from 1.1B to 124B parameters. The longest trained context is 195K tokens.
ET
steelskull_etheria-55b-v0.1
Etheria · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
ML
MLewd ReMM L2 Chat 20B
Mlewd · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
OR
ddh0_orcamaid-v3-13b-32k
Orcamaid · TheBloke
Params13B
Context32K
Q4_K_M7.9 GB
AI
airoboros l2 13B 3.0
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
firefly llama2 7B chat
Llama · TheBloke
Params6.93B
Context4K
Q4_K_M4.2 GB
XW
Xwin MLewd 7B V0.2
Xwin · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
speechlessai_speechless-mistral-7b-dare-0.85
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
SP
Spicyboros 7B 2.2
Spicyboros · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
undi95_mistral-claudelimarp-v3-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
NY
beberik_nyxene-v3-11b
Nyxene · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
aloobun_bun_mistral_7b_v2
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
HU
Huginn 22B Prototype
Huginn · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
LL
larryvrh_yi-34b-200k-llamafied
Llama · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
TH
Thespis 13B v0.4
Thespis · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CH
henk717_chronoboros-33b
Chronoboros · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
SP
Spicyboros 70B 2.2
Spicyboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
DI
digital socrates 13B
Digital · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MA
Marcoroni 13B
Marcoroni · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
VI
lmsys_vicuna-7b-v1.5-16k
Vicuna · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
CA
cyberagent_calm2-7b-chat
Calm · TheBloke
Params7.01B
Context32K
Q4_K_M4.3 GB
LL
OpenBuddy Llama2 70b v10.1
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
MI
chargoddard_mixtralnt-4x7b-test
Mistral · TheBloke
Params24.2B
Context32K
Q4_K_M13.6 GB
AI
airoboros l2 70B gpt4 1.4.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
OP
sanjiwatsuki_openchat-3.5-1210-starling-slerp
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
AL
ALMA 7B
Alma · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
LE
ignos_leoscorpius-greennode-alpaca-7b-v1
Leoscorpius · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
ajibawa-2023_uncensored-frank-7b
Uncensored · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
MI
maywell_pivot-10.7b-mistral-v0.2
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
LL
firefly llama2 13B chat
Llama · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
PE
perlthoughts_starling-lm-alpha-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB