Mfannv GGUF models
76 GGUF models in the Mfannv family, quantized by 4 uploaders. Sizes run from 7.24B to 8.03B parameters. The longest trained context is 128K tokens.
MF
MFANNv0.24 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANNv0.21 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANNv0.6
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
MF
MFANNv0.14
Mfannv · netcat420
Params8.03B
Context32K
Q4_K_M4.9 GB
MF
MFANNv0.4
Mfannv · netcat420
Params7.24B
Context32K
Smallest4.4 GB
MF
MFANNv0.8 GGUF DEFUNCT
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
MF
MFANNv0.25 Q8 0
Mfannv · netcat420
Params8.03B
Context128K
Smallest8.5 GB
MF
MFANNv0.7
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
MF
MFANNv0.13
Mfannv · netcat420
Params8.03B
Context32K
Smallest4.9 GB
MF
MFANNv0.23 Q8 0
Mfannv · netcat420
Params8.03B
Context128K
Smallest8.5 GB
MF
netcat420 MFANNv0.13.10
Mfannv · tensorblock
Params8.03B
Context32K
Smallest3.2 GB
MF
MFANNv0.17
Mfannv · netcat420
Params8.03B
Context32K
Q4_K_M4.9 GB
MF
netcat420 MFANNv0.16.10
Mfannv · tensorblock
Params8.03B
Context32K
Smallest3.2 GB
MF
MFANNv0.9
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
MF
MFANNv0.15
Mfannv · netcat420
Params8.03B
Context32K
Q4_K_M4.9 GB
MF
MFANNv0.16
Mfannv · netcat420
Params8.03B
Context32K
Smallest4.9 GB