GGUF models by LucileFavero
78 GGUF models quantized by LucileFavero on Hugging Face. Sizes run from 7.62B to 14.8B parameters. The longest trained context is 256K tokens.
GA
GAQ_qw_Q3
Gaq · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
AM
AMmodel4
Ammodel · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
AM
AMmodel2
Ammodel · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
AM model6
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
AM model eff6
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
AA
aaec_ll_T
Aaec · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
AA
aaec_T_dic1
Aaec · LucileFavero
Params7.62B
Context32K
Q4_K_M4.7 GB
AA
aaec_T_qw_dic1
Aaec · LucileFavero
Params7.62B
Context32K
Q4_K_M4.7 GB
AM
AMeff
Ameff · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
AA
aaec ll P2
Aaec · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GA
GAQ_qw_Q2
Gaq · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
AM
AMmodel
Ammodel · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
TE
test
Test · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
AM
AMmodel3
Ammodel · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
MO
AM model new
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
AA
aaec_T_ll_dic1
Aaec · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
DR
dress repro 3
Dress · LucileFavero
Params8.03B
Context128K
Smallest16.1 GB
DR
dress repro 2
Dress · LucileFavero
Params8.03B
Context128K
Smallest16.1 GB