GGUF models by v000000
34 GGUF models quantized by v000000 on Hugging Face. Sizes run from 7.24B to 46.7B parameters. The longest trained context is 1000K tokens.
TR
TripletBoreas-7B-t0.0001
Tripletboreas · v000000
Params7.24B
Context32K
Smallest7.7 GB
DU
DupletBoreas-7B-t0.0001
Dupletboreas · v000000
Params7.24B
Context32K
Smallest5.0 GB
LY
NM 12B Lyris dev 2 Q6 K
Lyris · v000000
Params12.2B
Context1000K
Smallest10.1 GB
TR
TripletBoreas 7B t0.0001 Q5 K S
Tripletboreas · v000000
Params7.24B
Context32K
Smallest5.0 GB