GGUF models by backyardai
121 GGUF models quantized by backyardai on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.
MI
mini magnum 12b v1.1
Mini · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
IN
InfinityKuno 2x7B
Infinitykuno · backyardai
Params12.9B
Context32K
Q4_K_M7.8 GB
ST
L3-8B-Stheno-v3.2
Stheno · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Replete-Coder-Llama3-8B
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
DA
DarkSapling-7B-v2.0
Darksapling · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
Fimbulvetr-Holodeck-Erebus-Westlake-10.7B
Fimbulvetr · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
LL
Llama-3-Soliloquy-8B-v2
Llama · backyardai
Params8.03B
Context24K
Q4_K_M4.9 GB
RO
Rocinante 12B v1.1
Rocinante · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gemmasutra Mini 2B v1
Gemma · backyardai
Params2.61B
Context8K
Q4_K_M1.7 GB
MA
Magnum V4 72B
Magnum · backyardai
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
Llama-3-Lumimaid-70B-v0.1
Llama · backyardai
Params70.6B
Context8K
Q4_K_M42.5 GB
EU
L3.3 70B Euryale v2.3
Euryale · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
BI
Bionic Cetacean 20B
Bionic · backyardai
Params20B
Context4K
Q4_K_M12.0 GB
MI
Midnight-Miqu-70B-v1.5
Midnight · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
UM
L3 Umbral Mind RP v3.0 8B
Umbral · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
DA
Dark-Miqu-70B
Dark · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
SP
Space-Whale-Lite-13B
Space · backyardai
Params13B
Context4K
Q4_K_M7.9 GB
CY
Cydonia 24B v2
Cydonia · backyardai
Params23.6B
Context32K
Q4_K_M14.3 GB
BI
Big-Lemon-Cookie-11B
Big · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
LL
llama-3-8b-Instruct
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 8B ArliAI RPMax v1.1
Llama · backyardai
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Mistral Small 24B ArliAI RPMax v1.4
Mistral · backyardai
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
Meta Llama 3.1 70B Instruct
Llama · backyardai
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
Big-Tiger-Gemma-27B-v1
Gemma · backyardai
Params27.2B
Context8K
Q4_K_M16.6 GB
CY
Cydonia 22B v1.3
Cydonia · backyardai
Params22.2B
Context32K
Q4_K_M13.3 GB
AY
aya-23-8B
Aya · backyardai
Params8.03B
Context8K
Q4_K_M5.1 GB
NE
Nemo 12B Marlin v5
Nemo · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
ST
L3 Stheno Maid Blackroot Grand HORROR 16B
Stheno · backyardai
Params16.5B
Context8K
Q4_K_M10.0 GB
BI
Bionic-Vaquita-13B
Bionic · backyardai
Params13B
Context4K
Q4_K_M7.9 GB