GGUF models by backyardai

121 GGUF models quantized by backyardai on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MY
Mytho-Lemon-11B
Mytho · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LY
MN 12B Lyra v3
Lyra · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
BU
Bungo L3 8B
Bungo · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NY
L3 Nymeria 15B
Nymeria · backyardai
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
HO
Honey Yuzu 13B
Honey · backyardai
Params12.5B
Context8K
Q4_K_M7.5 GB
Roleplay
GE
gemma2 gutenberg 9B
Gemma · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
DA
DarkForest 20B v3.0
Darkforest · backyardai
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
LL
New Dawn Llama 3.1 70B v1.1
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LU
L3 8B Lunaris v1
Lunaris · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HO
L3 Horizon Anteros Ara v0.1 9B
Horizon · backyardai
Params8.9B
Context8K
Q4_K_M5.4 GB
GGUF
SE
Senku-70B-Full
Senku · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
LL
Llama-3-Lumimaid-8B-v0.1-OAS
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AY
aya-23-35B
Aya · backyardai
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
LY
MN 12B Lyra v4
Lyra · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
SFR-Iterative-DPO-LLaMA-3-8B-R
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Soliloquy-8B
Llama · backyardai
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF
CE
Celeste 12B V1.6
Celeste · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SU
Sunmoy 9B G2
Sunmoy · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CH
Chaifighter-20B
Chaifighter · backyardai
Params20.8B
Context32K
Q4_K_M12.5 GB
GGUF
JA
Jamet 8B L3 MK.V Blackroot
Jamet · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
gemma2-9B-sunfall-v0.5.2
Gemma · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 9b It
Gemma · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
DU
Dusk_Rainbow
Dusk · backyardai
Params8.03B
Context10K
Q4_K_M4.9 GB
GGUF
QW
Qwen2-7B-Multilingual-RP
Qwen · backyardai
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
BL
L3-Blackfall-Summanus-v0.1-15B
Blackfall · backyardai
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
NY
L3 Nymeria 8B
Nymeria · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
HO
L3 Horizon Anteros v0.1 13B
Horizon · backyardai
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
NY
L3 Nymeria v2 8B
Nymeria · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
BL
L3-8.9B-Blackfall-SummanusAra-v0.1
Blackfall · backyardai
Params8.9B
Context8K
Q4_K_M5.4 GB
GGUF
CE
L3 8B Celeste V1.2
Celeste · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing