Apertus GGUF models

131 GGUF models in the Apertus family, quantized by 32 uploaders. Sizes run from 438M to 70.6B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AP
Apertus v1.1 1.5B
Apertus · NonMiFrega
Params1.51B
Context4K
Smallest1.6 GB
GGUF
AP
Apertus 8B Instruct 2509
Apertus · NonMiFrega
Params8.05B
Context64K
Q4_K_M5.1 GB
GGUF
AP
Apertus 8B 16bit
Apertus · YannickLetrefle
Params8.05B
Context64K
Smallest16.1 GB
ReasoningTool use
AP
Apertus Flotilla Merged
Apertus · ursushoribilis
Params8.05B
Context64K
Q4_K_M5.1 GB
GGUF
AP
Apertus 8B 2509
Apertus · actionpace
Params8.05B
Context64K
Smallest5.8 GB
GGUF
AP
Apertus v1.1 0.5B
Apertus · NonMiFrega
Params438M
Context4K
Smallest0.5 GB
GGUF
AP
apertus v1.1 swiss embed 0.4b bidir
Apertus · andreasmartin
Params573M
Context4K
Smallest0.6 GB
Embedding
AP
apertus 4b Q5 K M
Apertus · SH4P3S
Params3.83B
Context4K
Smallest2.8 GB
Tool use
AP
Apertus 8B Instruct 2509
Apertus · austinjp
Params8.05B
Context64K
Smallest4.7 GB
GGUF
AP
apertus 4b r2 Q5 K M
Apertus · SH4P3S
Params3.83B
Context4K
Smallest2.8 GB
Tool use
AP
apertus 4b tooluse
Apertus · SH4P3S
Params3.83B
Context4K
Smallest2.3 GB
Tool use

Keep browsing