Apertus GGUF models

131 GGUF models in the Apertus family, quantized by 32 uploaders. Sizes run from 438M to 70.6B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AP
Apertus 70B MeditronFO
Apertus · mradermacher
Params70.6B
Context64K
Q4_K_M43.7 GB
ReasoningTool use
AP
Apertus AlphaPO 5e 6 8B
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
GGUF
AP
Apertus AlphaPO A25 8B
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
GGUF
AP
karma electric apertus 8b
Apertus · anicka
Params8.05B
Context64K
Q4_K_M5.1 GB
ReasoningTool use
AP
Apertus v1.1 4B Instruct
Apertus · agentlans
Params3.83B
Context4K
Q4_K_M2.4 GB
Tool use
AP
Apertus 70B 2509
Apertus · actionpace
Params70.6B
Context64K
Q4_K_M43.7 GB
GGUF
AP
Apertus 8B Tulu3 Eng
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
GGUF
AP
Apertus 70B Instruct 2509 Heretic v2
Apertus · mradermacher
Params70.6B
Context64K
Q4_K_M43.7 GB
ReasoningTool use
AP
Apertus 70B Instruct 2509 Heretic v3
Apertus · mradermacher
Params70.6B
Context64K
Q4_K_M43.7 GB
ReasoningTool use
AP
Apertus 8B tulu xlam sft
Apertus · Colby
Params8.05B
Context64K
Q4_K_M5.1 GB
Tool use
AP
Apertus EstLLM 8B Instruct 0326
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
ReasoningTool use
AP
Swiss ai.Apertus 70B Instruct 2509
Apertus · DevQuasar
Params70.6B
Context64K
Q4_K_M43.7 GB
ReasoningTool use
AP
Apertus 8B Instruct 2509
Apertus · Lisnsharragh
Params8.05B
Context64K
Smallest4.2 GB
GGUF
AP
Apertus 8B Instruct 1601
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
ReasoningTool use
AP
Apertus 12b Healed S0
Apertus · mradermacher
Params11.5B
Context64K
Q4_K_M7.2 GB
GGUF
AP
Apertus v1.1 0.5B Instruct QAD Q4 1
Apertus · DMP96
Params573M
Context4K
Smallest0.7 GB
Tool use
AP
Apertus 8B Europa SFT Mix
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
GGUF
AP
Apertus 8B Instruct Heretic
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
ReasoningTool use
AP
Apertus 8b Instruct Heretic Marvin
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
ReasoningTool use
AP
Apertus 8B 2509 Patched chatML
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
GGUF
AP
Apertus v1.1 1.5B Instruct QAD Q4 1
Apertus · DMP96
Params1.51B
Context4K
Smallest1.7 GB
Tool use
AP
Apertus 70B 2509
Apertus · from-our-page
Params70.6B
Context64K
Q4_K_M43.7 GB
GGUF
AP
Apertus 8B FF 1601
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
ReasoningTool use
AP
Apertus 12b Try Again S0
Apertus · mradermacher
Params11.5B
Context64K
Q4_K_M7.2 GB
GGUF
AP
Apertus 70B Instruct 2509
Apertus · actionpace
Params70.6B
Context64K
Q4_K_M43.7 GB
ReasoningTool use
AP
Apertus 70b Legitron
Apertus · mradermacher
Params70.6B
Context64K
Q4_K_M43.7 GB
ReasoningTool use
AP
Apertus 0.5B Instruct
Apertus · mradermacher
Params573M
Context4K
Q4_K_M0.4 GB
Tool use
AP
Apertus 8B tulu xlam
Apertus · Colby
Params8.05B
Context64K
Q4_K_M5.1 GB
Tool use
AP
Apertus v1.1 4B
Apertus · mradermacher
Params3.83B
Context4K
Q4_K_M2.4 GB
GGUF
AP
ke v9 8b
Apertus · anicka
Params8.05B
Context64K
Smallest8.6 GB
ReasoningTool use

Keep browsing