GGUF models by backyardai

121 GGUF models quantized by backyardai on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-70b-Uncensored-Lumi-Tess-gradient
Llama · backyardai
Params70.6B
Context256K
Q4_K_M42.5 GB
GGUF
BL
BlackMagic-7B
Blackmagic · backyardai
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
HA
Hathor_Fractionate-L3-8B-v.05
Hathor · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NI
L3.1 8B Niitama v1.1
Niitama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
CH
Chaifighter 20B v3
Chaifighter · backyardai
Params19.5B
Context4K
Q4_K_M11.7 GB
Roleplay
RA
Raphael-7B
Raphael · backyardai
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
YI
Yi-34B-200K-RPMerge
Yi · backyardai
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
Llama 3.1 SuperNova Lite 8B
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CO
c4ai-command-r-plus
Command R · backyardai
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
MA
magnum-72b-v1
Magnum · backyardai
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
CH
MN Chunky Lotus 12B
Chunky · backyardai
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
LL
Artificium llama3.1 8B 001
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.3 70B Instruct
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
BA
MN BackyardAI Party 12B v1
Backyardai · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
AN
Anubis 70B v1
Anubis · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
CH
Chaifighter 20B v2.1
Chaifighter · backyardai
Params19.5B
Context8K
Q4_K_M11.7 GB
GGUF
CO
C4ai Command R 08 2024 34B
Command R · backyardai
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
CY
Cydonia 22B v1.2
Cydonia · backyardai
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
TE
Testarossa V1 27B
Testarossa · backyardai
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
CE
MN 12B Celeste V1.9
Celeste · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
Llama-3-Lumimaid-8B-v0.1
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Tiger-Gemma-9B-v1
Gemma · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemmoy-9B-MK.I
Gemmoy · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SN
SnowyRP FinalV1 L2 13B
Snowyrp · backyardai
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay
CH
Chaifighter-Latte-14B
Chaifighter · backyardai
Params14.2B
Context8K
Q4_K_M8.6 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
AG
L3.1 Aglow Vulca V0.1 8B
Aglow · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
Roleplay

Keep browsing