GGUF models by backyardai

121 GGUF models quantized by backyardai on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
mini magnum 12b v1.1
Mini · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
IN
InfinityKuno 2x7B
Infinitykuno · backyardai
Params12.9B
Context32K
Q4_K_M7.8 GB
Roleplay
ST
L3-8B-Stheno-v3.2
Stheno · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Replete-Coder-Llama3-8B
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
DA
DarkSapling-7B-v2.0
Darksapling · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
Fimbulvetr-Holodeck-Erebus-Westlake-10.7B
Fimbulvetr · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LL
Llama-3-Soliloquy-8B-v2
Llama · backyardai
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF
RO
Rocinante 12B v1.1
Rocinante · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
Gemmasutra Mini 2B v1
Gemma · backyardai
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MA
Magnum V4 72B
Magnum · backyardai
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
LL
Llama-3-Lumimaid-70B-v0.1
Llama · backyardai
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
EU
L3.3 70B Euryale v2.3
Euryale · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
BI
Bionic Cetacean 20B
Bionic · backyardai
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
MI
Midnight-Miqu-70B-v1.5
Midnight · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
UM
L3 Umbral Mind RP v3.0 8B
Umbral · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
DA
Dark-Miqu-70B
Dark · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
LL
Llama 3.1 8B Stheno v3.4
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SP
Space-Whale-Lite-13B
Space · backyardai
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CY
Cydonia 24B v2
Cydonia · backyardai
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
BI
Big-Lemon-Cookie-11B
Big · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
LL
llama-3-8b-Instruct
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Mistral Small 24B ArliAI RPMax v1.4
Mistral · backyardai
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GE
Big-Tiger-Gemma-27B-v1
Gemma · backyardai
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
CY
Cydonia 22B v1.3
Cydonia · backyardai
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
AY
aya-23-8B
Aya · backyardai
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
NE
Nemo 12B Marlin v5
Nemo · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
ST
L3 Stheno Maid Blackroot Grand HORROR 16B
Stheno · backyardai
Params16.5B
Context8K
Q4_K_M10.0 GB
GGUF
BI
Bionic-Vaquita-13B
Bionic · backyardai
Params13B
Context4K
Q4_K_M7.9 GB
Roleplay

Keep browsing