GGUF models by hardlyworking
37 GGUF models quantized by hardlyworking on Hugging Face. Sizes run from 4.02B to 32.8B parameters. The longest trained context is 1000K tokens.
BQ
4Bquanted
Bquanted · hardlyworking
Params6.87B
Context32K
Smallest4.1 GB
XG
Xgen Small 9B Instruct R
Xgen · hardlyworking
Params10.7B
Context256K
Smallest6.1 GB
BK
4Bkto Q8 0
Bkto · hardlyworking
Params4.41B
Context256K
Smallest4.7 GB
GO
Golden-Curry-12B
Golden · hardlyworking
Params12.2B
Context1000K
Smallest7.1 GB
HO
HoldMy4BKTO
Holdmy · hardlyworking
Params4.41B
Context256K
Smallest2.6 GB
FI
Final4BRC2
Final · hardlyworking
Params4.41B
Context256K
Smallest4.7 GB
HO
HoldMy4B
Holdmy · hardlyworking
Params4.41B
Context256K
Smallest2.6 GB