GGUF models by backyardai
121 GGUF models quantized by backyardai on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.
LL
Llama-3-70b-Uncensored-Lumi-Tess-gradient
Llama · backyardai
Params70.6B
Context256K
Q4_K_M42.5 GB
BL
BlackMagic-7B
Blackmagic · backyardai
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Llama 3.1 Nemotron 70B Instruct
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
HA
Hathor_Fractionate-L3-8B-v.05
Hathor · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
NI
L3.1 8B Niitama v1.1
Niitama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
CH
Chaifighter 20B v3
Chaifighter · backyardai
Params19.5B
Context4K
Q4_K_M11.7 GB
RA
Raphael-7B
Raphael · backyardai
Params7.24B
Context8K
Q4_K_M4.4 GB
YI
Yi-34B-200K-RPMerge
Yi · backyardai
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
Llama 3.1 SuperNova Lite 8B
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
CO
c4ai-command-r-plus
Command R · backyardai
Params104B
Context128K
Q4_K_M62.8 GB
LL
Hermes 3 Llama 3.1 70B
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
magnum-72b-v1
Magnum · backyardai
Params72.7B
Context32K
Q4_K_M47.4 GB
CH
MN Chunky Lotus 12B
Chunky · backyardai
Params12.2B
Context128K
Q4_K_M7.5 GB
LL
Artificium llama3.1 8B 001
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.3 70B Instruct
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
BA
MN BackyardAI Party 12B v1
Backyardai · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
AN
Anubis 70B v1
Anubis · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
CH
Chaifighter 20B v2.1
Chaifighter · backyardai
Params19.5B
Context8K
Q4_K_M11.7 GB
CO
C4ai Command R 08 2024 34B
Command R · backyardai
Params32.3B
Context128K
Q4_K_M19.8 GB
CY
Cydonia 22B v1.2
Cydonia · backyardai
Params22.2B
Context32K
Q4_K_M13.3 GB
TE
Testarossa V1 27B
Testarossa · backyardai
Params27.2B
Context8K
Q4_K_M16.6 GB
CE
MN 12B Celeste V1.9
Celeste · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama-3-Lumimaid-8B-v0.1
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Tiger-Gemma-9B-v1
Gemma · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemmoy-9B-MK.I
Gemmoy · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
SN
SnowyRP FinalV1 L2 13B
Snowyrp · backyardai
Params13B
Context4K
Q4_K_M7.9 GB
CH
Chaifighter-Latte-14B
Chaifighter · backyardai
Params14.2B
Context8K
Q4_K_M8.6 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
AG
L3.1 Aglow Vulca V0.1 8B
Aglow · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB