GGUF models by backyardai
121 GGUF models quantized by backyardai on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.
MY
Mytho-Lemon-11B
Mytho · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
LY
MN 12B Lyra v3
Lyra · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
BU
Bungo L3 8B
Bungo · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
NY
L3 Nymeria 15B
Nymeria · backyardai
Params15B
Context8K
Q4_K_M9.1 GB
HO
Honey Yuzu 13B
Honey · backyardai
Params12.5B
Context8K
Q4_K_M7.5 GB
GE
gemma2 gutenberg 9B
Gemma · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
DA
DarkForest 20B v3.0
Darkforest · backyardai
Params20B
Context4K
Q4_K_M12.0 GB
LL
New Dawn Llama 3.1 70B v1.1
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
LU
L3 8B Lunaris v1
Lunaris · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
HO
L3 Horizon Anteros Ara v0.1 9B
Horizon · backyardai
Params8.9B
Context8K
Q4_K_M5.4 GB
SE
Senku-70B-Full
Senku · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
LL
Llama-3-Lumimaid-8B-v0.1-OAS
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
AY
aya-23-35B
Aya · backyardai
Params35B
Context8K
Q4_K_M21.5 GB
LY
MN 12B Lyra v4
Lyra · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
SFR-Iterative-DPO-LLaMA-3-8B-R
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Soliloquy-8B
Llama · backyardai
Params8.03B
Context24K
Q4_K_M4.9 GB
CE
Celeste 12B V1.6
Celeste · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
SU
Sunmoy 9B G2
Sunmoy · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
CH
Chaifighter-20B
Chaifighter · backyardai
Params20.8B
Context32K
Q4_K_M12.5 GB
JA
Jamet 8B L3 MK.V Blackroot
Jamet · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
gemma2-9B-sunfall-v0.5.2
Gemma · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 9b It
Gemma · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
DU
Dusk_Rainbow
Dusk · backyardai
Params8.03B
Context10K
Q4_K_M4.9 GB
QW
Qwen2-7B-Multilingual-RP
Qwen · backyardai
Params7.62B
Context32K
Q4_K_M4.7 GB
BL
L3-Blackfall-Summanus-v0.1-15B
Blackfall · backyardai
Params15B
Context8K
Q4_K_M9.1 GB
NY
L3 Nymeria 8B
Nymeria · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
HO
L3 Horizon Anteros v0.1 13B
Horizon · backyardai
Params13.3B
Context8K
Q4_K_M8.1 GB
NY
L3 Nymeria v2 8B
Nymeria · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
BL
L3-8.9B-Blackfall-SummanusAra-v0.1
Blackfall · backyardai
Params8.9B
Context8K
Q4_K_M5.4 GB
CE
L3 8B Celeste V1.2
Celeste · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB