GGUF models by furproxy
38 GGUF models quantized by furproxy on Hugging Face. Sizes run from 8.95B to 34.7B parameters. The longest trained context is 256K tokens.
FU
9b 111
Furproxy · furproxy
Params8.95B
Context256K
Smallest9.5 GB
FU
9b 120
Furproxy · furproxy
Params8.95B
Context256K
Smallest9.5 GB
FU
9b 108
Furproxy · furproxy
Params8.95B
Context256K
Smallest9.5 GB
FU
9b 125 2
Furproxy · furproxy
Params8.95B
Context256K
Smallest9.5 GB
FU
9b 24
Furproxy · furproxy
Params8.95B
Context256K
Smallest17.9 GB
FU
9b 127
Furproxy · furproxy
Params8.95B
Context256K
Smallest9.5 GB
GG
35b 5 gguf 1.00l
Gguf · furproxy
Params34.7B
Context256K
Smallest24.0 GB
FU
9b 123
Furproxy · furproxy
Params8.95B
Context256K
Smallest9.5 GB