Mfann GGUF models
139 GGUF models in the Mfann family, quantized by 4 uploaders. Sizes run from 2.78B to 8.03B parameters. The longest trained context is 500K tokens.
MF
MFANN phigments slerp V3.2
Mfann · mradermacher
Params2.78B
Context128K
Q4_K_M1.7 GB
MF
MFANN3bv1.2 Q4 K S
Mfann · netcat420
Params2.78B
Context126K
Smallest1.6 GB
MF
MFANN3bv0.7.10
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
MF
MFANN3bv0.24 Q4 K M
Mfann · netcat420
Params2.78B
Context128K
Q4_K_M1.7 GB
MF
MFANN3b Q6 K
Mfann · netcat420
Params2.78B
Context128K
Smallest2.3 GB
MF
MFANN3bv0.22 Q6 K
Mfann · netcat420
Params2.78B
Context32K
Smallest2.3 GB
MF
MFANN SFT
Mfann · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
MF
MFANN3bv1.1 Q5 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.9 GB
MF
MFANN3b Q4 K M
Mfann · netcat420
Params2.78B
Context128K
Q4_K_M1.7 GB
MF
MFANN phigments slerp V3.4 Q4 K M
Mfann · netcat420
Params2.78B
Context2K
Q4_K_M1.7 GB
MF
MFANN3bv0.22
Mfann · mradermacher
Params2.78B
Context32K
Q4_K_M1.7 GB
MF
MFANN phigments slerp V3.3 Q8 0
Mfann · netcat420
Params2.78B
Context2K
Smallest3.0 GB
MF
MFANN3bv0.12
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN phigments slerp V3.3 Q6 K
Mfann · netcat420
Params2.78B
Context2K
Smallest2.3 GB
MF
MFANN phigments slerp V3.3 Q4 K M
Mfann · netcat420
Params2.78B
Context2K
Q4_K_M1.7 GB
MF
MFANN phigments slerp V3.3 Q4 0
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
MF
MFANN3bv0.23 Q5 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.9 GB
MF
MFANN3bv0.22 Q8 0
Mfann · netcat420
Params2.78B
Context32K
Smallest3.0 GB
MF
MFANN3bv1.1 Q4 K M
Mfann · netcat420
Params2.78B
Context128K
Q4_K_M1.7 GB
MF
MFANN3bv0.20.10 i1
Mfann · mradermacher
Params2.78B
Context32K
Q4_K_M1.7 GB
MF
MFANN phigments slerp V3.3 Q5 K M
Mfann · netcat420
Params2.78B
Context2K
Smallest2.0 GB
MF
MFANN3b Q5 K M
Mfann · netcat420
Params2.78B
Context128K
Smallest2.0 GB
MF
MFANN3bv1.2 Q5 K M
Mfann · netcat420
Params2.78B
Context126K
Smallest2.0 GB
MF
MFANN3bv0.8
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
MF
MFANN SFT
Mfann · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
MF
MFANN3bv1.3 Q4 K M
Mfann · netcat420
Params2.78B
Context128K
Q4_K_M1.7 GB
MF
MFANN3b Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
MF
MFANN3bv0.17
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN3bv0.23 Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
MF
MFANN3bv0.24 Q5 K M
Mfann · netcat420
Params2.78B
Context128K
Smallest2.0 GB