Airoboros GGUF models

221 GGUF models in the Airoboros family, quantized by 14 uploaders. Sizes run from 61M to 179B parameters. The longest trained context is 195K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AI
Airoboros C34B 3.1.2
Airoboros · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
GGUF
AI
airoboros 33b gpt4 1.4.1 PI 8192 fp16 Q4 K M
Airoboros · stardustcx
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
AI
Uukuguy Airoboros M 7b 3.1.2 Dare 0.85
Airoboros · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AI
Airoboros 33b 3.1.2
Airoboros · Nexesenex
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
AI
airoboros-l2-13b-gpt4-2.0
Airoboros · actionpace
Params13B
Context4K
Smallest9.8 GB
GGUF
AI
airoboros dpo 110b 3.3
Airoboros · mradermacher
Params111B
Context32K
Smallest41.2 GB
RoleplayTool use
AI
Airoboros M 7b 3.1.2
Airoboros · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AI
Airoboros L2 7b 2.2.1
Airoboros · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
AI
airoboros l2 70b 2.2.1 4bit quants
Airoboros · jondurbin
Params69B
Context4K
Smallest38.9 GB
GGUF
AI
airoboros 33b 3.1.2 q4 k m
Airoboros · jondurbin
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
AI
airoboros l2 c70b 3.1.2 q4 k m
Airoboros · jondurbin
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Keep browsing