Mfann GGUF models

139 GGUF models in the Mfann family, quantized by 4 uploaders. Sizes run from 2.78B to 8.03B parameters. The longest trained context is 500K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MF
MFANN3bv1.2 Q6 K
Mfann · netcat420
Params2.78B
Context126K
Smallest2.3 GB
GGUF
MF
MFANN3bv0.8.10
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.19
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.1
Mfann · netcat420
Params3.43B
Context2K
Smallest2.0 GB
GGUF
MF
MFANN3bv0.3
Mfann · netcat420
Params2.78B
Context2K
Smallest1.7 GB
GGUF
MF
MFANN3bv0.10
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.22 Q4 K M
Mfann · netcat420
Params2.78B
Context32K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv0.1
Mfann · mradermacher
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
MF
MFANN3bv1.1 Q8 0
Mfann · netcat420
Params2.78B
Context128K
Smallest3.0 GB
GGUF
MF
MFANN3bv1.1 Q6 K
Mfann · netcat420
Params2.78B
Context128K
Smallest2.3 GB
GGUF
MF
MFANN3bv0.14
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.22 Q5 K S
Mfann · netcat420
Params2.78B
Context32K
Smallest1.9 GB
GGUF
MF
MFANN3bv0.23 Q5 0
Mfann · netcat420
Params2.78B
Context128K
Smallest1.9 GB
GGUF
MF
MFANN3bv0.5
Mfann · netcat420
Params2.78B
Context2K
Smallest1.7 GB
GGUF
MF
MFANN3bv0.15.10 Q4 K M
Mfann · mattritchey
Params2.78B
Context32K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv0.4
Mfann · netcat420
Params2.78B
Context2K
Smallest1.7 GB
GGUF
MF
MFANN3bv0.23 Q5 K M
Mfann · netcat420
Params2.78B
Context128K
Smallest2.0 GB
GGUF
MF
MFANN3bv1.1 Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.23 Q6 K
Mfann · netcat420
Params2.78B
Context128K
Smallest2.3 GB
GGUF

Keep browsing