Pllum GGUF models

80 GGUF models in the Pllum family, quantized by 16 uploaders. Sizes run from 3.88B to 46.7B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PL
PLLuM 8x7B Nc Chat
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
PLLuM 8x7B Base 2412
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
PLLuM 4B Instruct 2512
Pllum · Jerzman
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
PL
PLLuM 8x7B nc instruct
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
PLLuM 12B nc instruct 2412
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PL
PLLuM 8x7B instruct
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
PLLuM 8x7B Chat
Pllum · Nondzu
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
PLLuM 8x7B Nc Base
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
PLLuM 4B Base 2512
Pllum · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
PL
PLLuM 12B Base
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PL
PLLuM 12B Base 2512
Pllum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
PL
CYFRAGOVPL PLLuM 12B Chat
Pllum · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
GGUF
PL
PLLuM 12B Instruct 2512
Pllum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
PL
Pllum_8B_Tuned
Pllum · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
PL
PLLuM 4B Chat 2512
Pllum · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
PL
PLLuM 12B Nc Chat 2412
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PL
PLLuM 8x7B Nc Chat 2412
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
PLLuM 12B Base 250801
Pllum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
PL
PLLuM 12B Base 2508
Pllum · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
PL
PLLuM 8x7B Base
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
PLLuM 12B Nc Base 2412
Pllum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PL
PLLuM 8x7B Base 2412
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
PLLuM 8x7B instruct 2412
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
PLLuM 12B nc instruct
Pllum · piotreknow02
Params12.2B
Context1000K
Smallest5.0 GB
GGUF
PL
PLLuM 12B Chat 2512
Pllum · 0gites
Params12.2B
Context128K
Smallest10.1 GB
GGUF
PL
PLLuM 8x7B Nc Chat 2412
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
PLLuM 12B nc instruct
Pllum · tsej
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PL
PLLuM 4B Chat 2512
Pllum · Jerzman
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
PL
PLLuM 12B Base 2512
Pllum · Jerzman
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
PL
PLLuM 12B Nc Chat
Pllum · altomek
Params12.2B
Context1000K
Smallest7.1 GB
GGUF

Keep browsing