GGUF models by Lamapi
81 GGUF models quantized by Lamapi on Hugging Face. Sizes run from 268M to 32.8B parameters. The longest trained context is 256K tokens.
NE
Next 1b
Next · Lamapi
Params1B
Context32K
Smallest0.8 GB
NE
Next 8b
Next · Lamapi
Params8.19B
Context128K
Smallest4.6 GB
NE
Next 270m
Next · Lamapi
Params268M
Context32K
Q4_K_M0.3 GB
NE
Next 270m
Next · Lamapi
Params268M
Context32K
Smallest0.3 GB
NE
Next 8b
Next · Lamapi
Params8.19B
Context128K
Smallest8.7 GB
NE
Next 12b
Next · Lamapi
Params11.8B
Context128K
Smallest4.8 GB
NE
Next Ocr
Next · Lamapi
Params8.19B
Context256K
Smallest3.3 GB
NE
Next 4b
Next · Lamapi
Params3.88B
Context128K
Smallest2.2 GB
NE
Next 1b
Next · Lamapi
Params1B
Context32K
Smallest0.8 GB
NE
Next 8b
Next · Lamapi
Params8.19B
Context128K
Smallest4.8 GB
NE
Next 4b
Next · Lamapi
Params3.88B
Context128K
Smallest1.7 GB
NE
Next 4b
Next · Lamapi
Params3.88B
Context128K
Smallest2.8 GB
NE
Next 1b
Next · Lamapi
Params1B
Context32K
Smallest0.7 GB
NE
Next 270m
Next · Lamapi
Params268M
Context32K
Smallest0.2 GB
NE
Next 14b
Next · Lamapi
Params14.8B
Context40K
Smallest7.3 GB
NE
Next 4b
Next · Lamapi
Params3.88B
Context128K
Smallest2.4 GB
NE
Next 8b
Next · Lamapi
Params8.19B
Context128K
Smallest5.7 GB
NE
Next 270m
Next · Lamapi
Params268M
Context32K
Smallest0.2 GB
NE
Next 4b
Next · Lamapi
Params3.88B
Context128K
Smallest1.9 GB
NE
Next 4b
Next · Lamapi
Params3.88B
Context128K
Smallest2.1 GB
NE
Next 14b
Next · Lamapi
Params14.8B
Context40K
Smallest7.9 GB
NE
Next 14b
Next · Lamapi
Params14.8B
Context40K
Smallest6.7 GB
NE
Next 1b
Next · Lamapi
Params1B
Context32K
Smallest0.8 GB
NE
Next 270m
Next · Lamapi
Params268M
Context32K
Smallest0.2 GB
NE
Next 14b
Next · Lamapi
Params14.8B
Context40K
Smallest5.8 GB
NE
Next 1b
Next · Lamapi
Params1B
Context32K
Smallest0.8 GB
NE
Next Ocr
Next · Lamapi
Params8.19B
Context256K
Smallest5.7 GB
NE
Next 8b
Next · Lamapi
Params8.19B
Context128K
Smallest3.8 GB
NE
Next 8b
Next · Lamapi
Params8.19B
Context128K
Smallest5.9 GB
NE
Next 270m
Next · Lamapi
Params268M
Context32K
Smallest0.2 GB