GGUF models by hardlyworking

37 GGUF models quantized by hardlyworking on Hugging Face. Sizes run from 4.02B to 32.8B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
BQ
4Bquanted
Bquanted · hardlyworking
Params6.87B
Context32K
Smallest4.1 GB
GGUF
XG
Xgen Small 9B Instruct R
Xgen · hardlyworking
Params10.7B
Context256K
Smallest6.1 GB
GGUF
BK
4Bkto Q8 0
Bkto · hardlyworking
Params4.41B
Context256K
Smallest4.7 GB
GGUF
GO
Golden-Curry-12B
Golden · hardlyworking
Params12.2B
Context1000K
Smallest7.1 GB
GGUF
HO
HoldMy4BKTO
Holdmy · hardlyworking
Params4.41B
Context256K
Smallest2.6 GB
GGUF
FI
Final4BRC2
Final · hardlyworking
Params4.41B
Context256K
Smallest4.7 GB
GGUF
HO
HoldMy4B
Holdmy · hardlyworking
Params4.41B
Context256K
Smallest2.6 GB
GGUF

Keep browsing