GGUF models by backyardai

121 GGUF models quantized by backyardai on Hugging Face. Sizes run from 2.61B to 141B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
L3 Horizon Anteros v0.1.5 13B
Horizon · backyardai
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF

Keep browsing