GGUF models by blueming85
34 GGUF models quantized by blueming85 on Hugging Face. Sizes run from 1.78B to 8.03B parameters. The longest trained context is 128K tokens.
ME
metro2000
Metro · blueming85
Params8.03B
Context8K
Smallest8.5 GB
PU
pusanv0
Pusanv · blueming85
Params3.23B
Context128K
Smallest3.4 GB
RE
red200
Red · blueming85
Params3.21B
Context128K
Smallest3.4 GB
RE
red100
Red · blueming85
Params8.03B
Context128K
Smallest8.5 GB