GGUF models by Gille

57 GGUF models quantized by Gille on Hugging Face. Sizes run from 7.24B to 7.24B parameters. The longest trained context is 32K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
StrangeMerges 29 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 56 7B model stock
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 30 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 32 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 43 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 47 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 55 7B model stock
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 15 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 51 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 31 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 34 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 37 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 12 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 13 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 14 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 24 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 25 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 33 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 49 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 41 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 4 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 16 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 22 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 28 7B dare ties
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 8 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 23 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StrangeMerges 36 7B slerp
Strangemerges · Gille
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing