Pllum GGUF models

80 GGUF models in the Pllum family, quantized by 16 uploaders. Sizes run from 3.88B to 46.7B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PL
PLLuM 12B Nc Chat
Pllum · LubuskieCentrumCyfryzacji
Params12.2B
Context1000K
Smallest24.5 GB
GGUF
PL
PLLuM 8x7B nc instruct
Pllum · piotreknow02
Params46.7B
Context32K
Smallest10.3 GB
GGUF
PL
PLLuM 12B nc instruct Q6 K
Pllum · NikolayKozloff
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
PL
PLLuM 12B nc instruct Q6 K
Pllum · najdek
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
PL
PLLuM 12B nc instruct Q4 K M
Pllum · najdek
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PL
PLLuM 12B Nc Chat
Pllum · oki0ki
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
PL
PLLuM 12B Instruct
Pllum · NikolayKozloff
Params12.2B
Context128K
Smallest8.7 GB
GGUF
PL
PLLuM 12B Base
Pllum · najdek
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
PL
PLLuM 12B Instruct
Pllum · NikolayKozloff
Params12.2B
Context128K
Smallest10.1 GB
GGUF
PL
PLLuM 4B Base 2512
Pllum · Jerzman
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
PL
PLLuM 12B Chat 2512
Pllum · Jerzman
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
PL
PLLuM 12B Nc Chat
Pllum · LubuskieCentrumCyfryzacji
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
PL
PLLuM 12B Instruct 2512
Pllum · Jerzman
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
PL
PLLuM 12B Nc Chat
Pllum · najdek
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
PL
PLLuM 12B Nc Chat
Pllum · piotreknow02
Params12.2B
Context1000K
Smallest13.0 GB
GGUF
PL
PLLuM 4B instruct 2512 LEGAL
Pllum · 2c64bc59nr-dev
Params3.88B
Context128K
Smallest4.1 GB
GGUF
PL
PLLuM 12B nc instruct Q5 K M
Pllum · NikolayKozloff
Params12.2B
Context1000K
Smallest8.7 GB
GGUF
PL
PLLuM 8x7B Chat
Pllum · adach27
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PL
PLLuM 12B Chat
Pllum · altomek
Params12.2B
Context128K
Smallest7.1 GB
GGUF
PL
PLLuM 12B Instruct
Pllum · Rustamshry
Params12.2B
Context128K
Smallest13.0 GB
GGUF

Keep browsing