GGUF models by LucileFavero

78 GGUF models quantized by LucileFavero on Hugging Face. Sizes run from 7.62B to 14.8B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
GA
GAQ_qw_Q3
Gaq · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AM
AMmodel4
Ammodel · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AM
AMmodel2
Ammodel · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
AM model6
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
AM model eff6
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AA
aaec_ll_T
Aaec · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AA
aaec_T_dic1
Aaec · LucileFavero
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
AA
aaec_T_qw_dic1
Aaec · LucileFavero
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
AM
AMeff
Ameff · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AA
aaec ll P2
Aaec · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GA
GAQ_qw_Q2
Gaq · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AM
AMmodel
Ammodel · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TE
test
Test · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AM
AMmodel3
Ammodel · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MO
AM model new
Model · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AA
aaec_T_ll_dic1
Aaec · LucileFavero
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
DR
dress repro 3
Dress · LucileFavero
Params8.03B
Context128K
Smallest16.1 GB
GGUF
DR
dress repro 2
Dress · LucileFavero
Params8.03B
Context128K
Smallest16.1 GB
GGUF

Keep browsing