Mfann GGUF models

139 GGUF models in the Mfann family, quantized by 4 uploaders. Sizes run from 2.78B to 8.03B parameters. The longest trained context is 500K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MF
MFANN3bv0.20.12 i1
Mfann · mradermacher
Params2.78B
Context32K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv0.6 i1
Mfann · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MF
MFANN phigments slerp V2
Mfann · mradermacher
Params2.78B
Context32K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv0.24
Mfann · mradermacher
Params2.78B
Context128K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv1.4 i1
Mfann · mradermacher
Params2.78B
Context128K
Q4_K_M1.7 GB
GGUF
MF
MFANN3b SFT Rebase
Mfann · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv1.1
Mfann · mradermacher
Params2.78B
Context128K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv0.21
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
GGUF
MF
MFANN SFT
Mfann · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MF
MFANN liminerity slerp 3a i1
Mfann · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv0.6
Mfann · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MF
MFANN phigments slerp 1a
Mfann · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv0.24 Q6 K
Mfann · netcat420
Params2.78B
Context128K
Smallest2.3 GB
GGUF
MF
MFANN3bv0.5
Mfann · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MF
MFANN3b SFT
Mfann · mradermacher
Params2.78B
Context128K
Q4_K_M1.7 GB
GGUF
MF
MFANN phigments slerp 3b
Mfann · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MF
MFANN liminerity slerp V4
Mfann · tensorblock
Params2.78B
Context128K
Smallest1.1 GB
GGUF
MF
MFANN3bv0.20.12
Mfann · mradermacher
Params2.78B
Context32K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv0.21
Mfann · mradermacher
Params2.78B
Context32K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv0.17.12
Mfann · mradermacher
Params2.78B
Context32K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv1.4
Mfann · mradermacher
Params2.78B
Context128K
Q4_K_M1.7 GB
GGUF
MF
MFANN3b Q5 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.9 GB
GGUF
MF
MFANN3bv0.7
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.20.14
Mfann · mradermacher
Params2.78B
Context32K
Q4_K_M1.7 GB
GGUF
MF
MFANN liminerity slerp V4
Mfann · mradermacher
Params2.78B
Context128K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv0.4
Mfann · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MF
MFANN liminerity slerp 3a
Mfann · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
MF
MFANN phigments slerp V3.3 Q4 K S
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
GGUF
MF
MFANN phigments slerp V2
Mfann · tensorblock
Params2.78B
Context32K
Smallest1.1 GB
GGUF
MF
MFANN3b Q8 0
Mfann · netcat420
Params2.78B
Context128K
Smallest3.0 GB
GGUF

Keep browsing