GGUF models by backyardai

121 GGUF models quantized by backyardai on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NeuralLemon 7B
Neurallemon · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WE
WestLake 10.7B v2
Westlake · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
QU
QuartetAnemoi 70B t0.0001
Quartetanemoi · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
MI
Hermes 2 Pro Mistral 7B
Mistral · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Midnight-Rose-70B-v2.0.3
Midnight · backyardai
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
WI
WizardLM-2-8x22B
Wizardlm · backyardai
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
IC
Iced-Lemon-Cookie-7B
Iced · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
Fimbulvetr-11B-v2
Fimbulvetr · backyardai
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LE
LemonadeRP 4.5.3
Lemonaderp · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
Chunky-Lemon-Cookie-11B
Chunky · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
VI
MN Violet Lotus 12B
Violet · backyardai
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
PH
Phi 3 mini 4k instruct
Phi · backyardai
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
LL
Esper-70b
Llama · backyardai
Params69B
Context4K
Q4_K_M41.4 GB
Coding
SM
Smart-Lemon-Cookie-7B
Smart · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · backyardai
Params10.7B
Context16K
Q4_K_M6.5 GB
GGUF
PS
Psyonic-Cetacean-V1-20B-Ultra-Quality-Float32
Psyonic · backyardai
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
DA
Dark-Miqu-103B
Dark · backyardai
Params103B
Context32K
Q4_K_M61.9 GB
GGUF
CH
Chaifighter-20B-v2
Chaifighter · backyardai
Params19.5B
Context4K
Q4_K_M11.7 GB
GGUF
ST
L3-8B-Stheno-v3.3-32K
Stheno · backyardai
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
CO
c4ai command r v01
Command R · backyardai
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · backyardai
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Mistral Nemo Instruct 2407 13B
Mistral · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
CH
Chewy-Lemon-Cookie-11B
Chewy · backyardai
Params10.7B
Context8K
Q4_K_M6.5 GB
Roleplay
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
CE
Cerebrum 1.0 8x7b
Cerebrum · backyardai
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
NE
NeuralBeagle14-7B
Neuralbeagle · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
Llama-3-8B-Ultra-Instruct
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
EVA Qwen2.5 32B v0.2
Qwen · backyardai
Params32.8B
Context128K
Q4_K_M19.9 GB
Roleplay
LL
Hermes 3 Llama 3.1 8B
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
SE
Senku-70B-Full
Senku · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
GGUF

About backyardai on Hugging Face

backyardai has published 121 GGUF models that ggufmodels.com tracks, across families such as Llama, Gemma and Chaifighter. The most downloaded are NeuralLemon 7B, WestLake 10.7B v2 and QuartetAnemoi 70B t0.0001.

The quants backyardai publishes most often are Q8_0 (121), Q6_K (121), Q5_K_S (121) and Q5_K_M (121). Their Q4_K_M files range from 1.7 to 85.6 GB. Parameter counts run from 2.61B to 141B, and the longest trained context window is 1000K tokens.

Frequently asked questions

What GGUF models has backyardai published?

121 models are listed here, mainly from the Llama, Gemma and Chaifighter families. The most downloaded is NeuralLemon 7B.

Which quants does backyardai publish?

The most common are Q8_0 (121 models), Q6_K (121 models), Q5_K_S (121 models) and Q5_K_M (121 models).

Keep browsing