Mfann GGUF models
139 GGUF models in the Mfann family, quantized by 4 uploaders. Sizes run from 2.78B to 8.03B parameters. The longest trained context is 500K tokens.
MF
MFANN3bv0.20.10
Mfann · mradermacher
Params2.78B
Context32K
Q4_K_M1.7 GB
MF
MFANN Phigments Slerp V4 BETA1
Mfann · netcat420
Params2.78B
Context500K
Q4_K_M1.7 GB
MF
MFANN3bv0.22 Q5 K M
Mfann · netcat420
Params2.78B
Context32K
Smallest2.0 GB
MF
MFANN3bv1.1 Q5 K M
Mfann · netcat420
Params2.78B
Context128K
Smallest2.0 GB
MF
MFANN3bv1.2 Q5 K S
Mfann · netcat420
Params2.78B
Context126K
Smallest1.9 GB
MF
MFANN3bv0.24 Q5 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.9 GB
MF
MFANN Phigments Slerp V4 BETA1
Mfann · netcat420
Params2.78B
Context500K
Smallest1.6 GB
MF
MFANN3bv1.2 Q8 0
Mfann · netcat420
Params2.78B
Context126K
Smallest3.0 GB
MF
MFANN3bv0.23 Q4 K M
Mfann · netcat420
Params2.78B
Context128K
Q4_K_M1.7 GB
MF
MFANN3bv0.16
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN phigments slerp V3.3 Q5 K S
Mfann · netcat420
Params2.78B
Context2K
Smallest1.9 GB
MF
MFANN phigments slerp 2b
Mfann · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
MF
MFANN3bv0.2
Mfann · netcat420
Params2.78B
Context2K
Smallest1.7 GB
MF
MFANN3bv0.24 Q8 0
Mfann · netcat420
Params2.78B
Context128K
Smallest3.0 GB
MF
MFANN3bv1.3 Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
MF
MFANN phigments slerp V3.4 Q4 K S
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
MF
MFANN3b SFT
Mfann · tensorblock
Params2.78B
Context128K
Smallest1.1 GB
MF
MFANN3bv0.20
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN3bv0.24 Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
MF
MFANN3bv0.22 Q4 K S
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN3bv1.2 Q5 0
Mfann · netcat420
Params2.78B
Context126K
Smallest1.9 GB
MF
MFANN3bv0.9
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
MF
MFANN Phigments Slerp V4 BETA1
Mfann · netcat420
Params2.78B
Context500K
Smallest1.6 GB
MF
MFANN3bv0.13
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN phigments slerp V3.4 Q4 0
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
MF
MFANN3bv0.23 Q8 0
Mfann · netcat420
Params2.78B
Context128K
Smallest3.0 GB
MF
MFANN3bv0.11
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN3bv0.15
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN3bv0.18
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN3bv1.2 Q4 K M
Mfann · netcat420
Params2.78B
Context126K
Q4_K_M1.7 GB