Apollo GGUF models

105 GGUF models in the Apollo family, quantized by 26 uploaders. Sizes run from 14M to 70.6B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AP
Apollo-6B
Apollo · BoscoTheDog
Params6.06B
Context4K
Smallest7.0 GB
GGUF
AP
Apollo2 0.5B
Apollo · X054848
Params630M
Context128K
Smallest0.7 GB
GGUF
AP
Apollo 16k Large Instruct
Apollo · mradermacher
Params69B
Context32K
Q4_K_M42.3 GB
GGUF
AP
Apollo 34B
Apollo · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
AP
Apollo 7B
Apollo · itlwas
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
AP
Apollo 6B
Apollo · killgfat
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
AP
Apollo 2B
Apollo · itlwas
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
AP
Apollo-7B
Apollo · nuojohnchen
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
AP
Apollo2 2B
Apollo · fernandoruiz
Params2.61B
Context8K
Smallest1.6 GB
GGUF
AP
Apollo 0.5B
Apollo · itlwas
Params464M
Context32K
Q4_K_M0.3 GB
GGUF
AP
Apollo2 7B
Apollo · nuojohnchen
Params7.62B
Context128K
Smallest8.1 GB
GGUF
AP
Apollo 7B
Apollo · killgfat
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
AP
Apollo 24B Q6 K
Apollo · WesPro
Params23.6B
Context32K
Smallest19.3 GB
GGUF
AP
Apollo2 7B
Apollo · nuojohnchen
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
AP
Apollo 34b
Apollo · jamesyooo
Params34.4B
Context4K
Smallest23.6 GB
GGUF

Keep browsing