GGUF models by Gille
57 GGUF models quantized by Gille on Hugging Face. Sizes run from 7.24B to 7.24B parameters. The longest trained context is 32K tokens.
ST
StrangeMerges 29 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 56 7B model stock
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 30 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 32 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 43 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 47 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 55 7B model stock
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 15 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 51 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 31 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 34 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 37 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 12 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 13 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 14 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 24 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 25 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 33 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 49 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 41 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 4 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 16 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 22 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 28 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 8 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 23 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StrangeMerges 36 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB