GGUF models by shidowake

36 GGUF models quantized by shidowake on Hugging Face. Sizes run from 2.8B to 13.1B parameters. The longest trained context is 32K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
240405 chatntq ja 7b v1 co0.8 mist inst v0.2 edit config
Chatntq · shidowake
Params7.24B
Context32K
Smallest7.7 GB
GGUF
SW
240301 swal 13b base bnb4bit deftok retry qlora adaptor fp16merged
Swal · shidowake
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
SW
240301 swal 13b base bnb deftok r32 mix ja 9k qlora adaptor fp16merged
Swal · shidowake
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
SW
240301 swal 13b base bnb deftok r16 mix ja 9k qlora adaptor fp16merged
Swal · shidowake
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
RE
revise 240301 swal 13b base bnb deftok r32 mix ja 9k qlora adaptor fp16merged
Revise · shidowake
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
CA
calm2chat dpo
Calm · shidowake
Params7.01B
Context32K
Smallest7.5 GB
GGUF

Keep browsing