GGUF models by shidowake
36 GGUF models quantized by shidowake on Hugging Face. Sizes run from 2.8B to 13.1B parameters. The longest trained context is 32K tokens.
CH
240405 chatntq ja 7b v1 co0.8 mist inst v0.2 edit config
Chatntq · shidowake
Params7.24B
Context32K
Smallest7.7 GB
SW
240301 swal 13b base bnb4bit deftok retry qlora adaptor fp16merged
Swal · shidowake
Params13.1B
Context4K
Q4_K_M7.9 GB
SW
240301 swal 13b base bnb deftok r32 mix ja 9k qlora adaptor fp16merged
Swal · shidowake
Params13.1B
Context4K
Q4_K_M7.9 GB
SW
240301 swal 13b base bnb deftok r16 mix ja 9k qlora adaptor fp16merged
Swal · shidowake
Params13.1B
Context4K
Q4_K_M7.9 GB
RE
revise 240301 swal 13b base bnb deftok r32 mix ja 9k qlora adaptor fp16merged
Revise · shidowake
Params13.1B
Context4K
Q4_K_M7.9 GB
CA
calm2chat dpo
Calm · shidowake
Params7.01B
Context32K
Smallest7.5 GB