Mfannv GGUF models

76 GGUF models in the Mfannv family, quantized by 4 uploaders. Sizes run from 7.24B to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MF
MFANNv0.23 Q6 K
Mfannv · netcat420
Params8.03B
Context128K
Smallest6.6 GB
GGUF
MF
MFANNv0.24 Q8 0
Mfannv · netcat420
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MF
netcat420 MFANNv0.19.12
Mfannv · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
MF
MFANNv0.22.1 Q8 0
Mfannv · netcat420
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MF
MFANNv0.24 Q5 K M
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.7 GB
GGUF
MF
MFANNv0.5
Mfannv · netcat420
Params7.24B
Context32K
Smallest4.4 GB
GGUF
MF
MFANNv0.11
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
GGUF
MF
MFANNv0.25 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
MF
MFANNv0.23 Q5 K M
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.7 GB
GGUF
MF
MFANNv0.24 Q5 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.6 GB
GGUF
MF
MFANNv0.4
Mfannv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MF
MFANNv0.24 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
MF
MFANNv0.10
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
GGUF
MF
MFANNv0.22.1 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
MF
MFANNv0.25 Q5 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.6 GB
GGUF
MF
MFANNv0.8
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
GGUF
MF
netcat420 MFANNv0.15.10
Mfannv · tensorblock
Params8.03B
Context32K
Smallest3.2 GB
GGUF
MF
MFANNv0.22.1 Q6 K
Mfannv · netcat420
Params8.03B
Context128K
Smallest6.6 GB
GGUF
MF
MFANNv0.25 Q5 K M
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.7 GB
GGUF
MF
MFANNv0.25 Q6 K
Mfannv · netcat420
Params8.03B
Context128K
Smallest6.6 GB
GGUF
MF
MFANNv0.22.1 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MF
MFANNv0.19 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MF
MFANNv0.12
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.9 GB
GGUF
MF
MFANNv0.24 Q6 K
Mfannv · netcat420
Params8.03B
Context128K
Smallest6.6 GB
GGUF
MF
MFANNv0.2
Mfannv · netcat420
Params7.24B
Context32K
Smallest4.4 GB
GGUF
MF
MFANNv0.18 Q4 K M
Mfannv · netcat420
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
MF
MFANNv0.3
Mfannv · netcat420
Params7.24B
Context32K
Smallest4.4 GB
GGUF
MF
MFANNv0.23 Q5 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.6 GB
GGUF
MF
MFANNv0.25 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MF
MFANNv0.21 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF

Keep browsing