GGUF models by netcat420
231 GGUF models quantized by netcat420 on Hugging Face. Sizes run from 1.91B to 8.19B parameters. The longest trained context is 500K tokens.
MF
MFANN3bv0.13
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANNv0.23 Q5 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.6 GB
QW
qwen2.5 MFANN 7b SLERP V1.4 Q4 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest4.5 GB
MF
MFANN phigments slerp V3.4 Q4 0
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
LL
Llama3.1 MFANN 8b Q5 K M
Llama · netcat420
Params8.03B
Context128K
Smallest5.7 GB
MF
MFANNv0.25 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANN3bv0.23 Q8 0
Mfann · netcat420
Params2.78B
Context128K
Smallest3.0 GB
QW
qwen2.5 MFANN 7b SLERP V1.3 Q4 K M
Qwen · netcat420
Params7.62B
Context32K
Q4_K_M4.7 GB
MF
MFANNv0.21 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
MF
MFANN3bv0.11
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MH
MHENN3.5
Mhenn · netcat420
Params7.24B
Context32K
Smallest4.4 GB
MF
MFANNv0.24 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 7b MFANN slerp Q5 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest5.3 GB
DE
Qwen2.5 DeepSeek R1 MFANN 7b Q5 0
DeepSeek · netcat420
Params7.62B
Context4K
Smallest5.3 GB
MF
MFANN3bv0.15
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANNv0.21 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANNv0.6
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
MF
MFANN3bv0.18
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN3bv1.2 Q4 K M
Mfann · netcat420
Params2.78B
Context126K
Q4_K_M1.7 GB
MF
MFANNv0.14
Mfannv · netcat420
Params8.03B
Context32K
Q4_K_M4.9 GB
MF
MFANN3bv1.2 Q6 K
Mfann · netcat420
Params2.78B
Context126K
Smallest2.3 GB
QW
qwen2.5 MFANN 7b SLERP V1.2 Q4 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest4.5 GB
MF
MFANN3bv0.8.10
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
MF
MFANN3bv0.19
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN3bv0.1
Mfann · netcat420
Params3.43B
Context2K
Smallest2.0 GB
MF
MFANNv0.4
Mfannv · netcat420
Params7.24B
Context32K
Smallest4.4 GB
MF
MFANN3bv0.3
Mfann · netcat420
Params2.78B
Context2K
Smallest1.7 GB
MF
MFANNv0.8 GGUF DEFUNCT
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
MF
MFANN3bv0.10
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
MF
MFANN3bv0.22 Q4 K M
Mfann · netcat420
Params2.78B
Context32K
Q4_K_M1.7 GB