GGUF models by blueming85

34 GGUF models quantized by blueming85 on Hugging Face. Sizes run from 1.78B to 8.03B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
metro2000
Metro · blueming85
Params8.03B
Context8K
Smallest8.5 GB
GGUF
PU
pusanv0
Pusanv · blueming85
Params3.23B
Context128K
Smallest3.4 GB
Tool use
RE
red200
Red · blueming85
Params3.21B
Context128K
Smallest3.4 GB
Tool use
RE
red100
Red · blueming85
Params8.03B
Context128K
Smallest8.5 GB
Tool use

Keep browsing