GGUF models by netcat420
231 GGUF models quantized by netcat420 on Hugging Face. Sizes run from 1.91B to 8.19B parameters. The longest trained context is 500K tokens.
MF
MFANN3bv0.24 Q4 K M
Mfann · netcat420
Params2.78B
Context128K
Q4_K_M1.7 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · netcat420
Params8.19B
Context500K
Smallest8.7 GB
MF
MFANN3b Q6 K
Mfann · netcat420
Params2.78B
Context128K
Smallest2.3 GB
MF
MFANNv0.24 Q5 K M
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.7 GB
MH
MHENN5
Mhenn · netcat420
Params7.24B
Context32K
Smallest4.4 GB
MF
MFANN3bv0.22 Q6 K
Mfann · netcat420
Params2.78B
Context32K
Smallest2.3 GB
MF
MFANN3bv1.1 Q5 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.9 GB
MF
MFANN3b Q4 K M
Mfann · netcat420
Params2.78B
Context128K
Q4_K_M1.7 GB
MF
MFANN phigments slerp V3.4 Q4 K M
Mfann · netcat420
Params2.78B
Context2K
Q4_K_M1.7 GB
MF
MFANNv0.5
Mfannv · netcat420
Params7.24B
Context32K
Smallest4.4 GB
MF
MFANN phigments slerp V3.3 Q8 0
Mfann · netcat420
Params2.78B
Context2K
Smallest3.0 GB
MF
MFANN3bv0.12
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
QW
Qwen2.5 MFANN 7b Q5 K M
Qwen · netcat420
Params7.62B
Context32K
Smallest5.4 GB
QW
Qwen2.5 7b MFANNv1.1 Q4 K M
Qwen · netcat420
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
qwen2.5 MFANN 7b SLERPv1.1 Q4 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest4.5 GB
MF
MFANN phigments slerp V3.3 Q6 K
Mfann · netcat420
Params2.78B
Context2K
Smallest2.3 GB
MF
MFANN phigments slerp V3.3 Q4 K M
Mfann · netcat420
Params2.78B
Context2K
Q4_K_M1.7 GB
MF
MFANN phigments slerp V3.3 Q4 0
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
QW
Qwen2.5 MFANN 7b SLERP V2 BETA1 512k
Qwen · netcat420
Params7.62B
Context500K
Q4_K_M4.7 GB
QW
Qwen2.5 7b MFANN slerp Q4 K M
Qwen · netcat420
Params7.62B
Context32K
Q4_K_M4.7 GB
MF
MFANN3bv0.23 Q5 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.9 GB
MF
MFANNv0.11
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
QW
Qwen2.5 7b nerd uncensored MFANN slerp Q5 0
Qwen · netcat420
Params7.62B
Context32K
Smallest5.3 GB
MF
MFANN3bv0.22 Q8 0
Mfann · netcat420
Params2.78B
Context32K
Smallest3.0 GB
MF
MFANNv0.25 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
QW
Qwen2.5 7b nerd uncensored MFANN slerp Q5 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest5.3 GB
MF
MFANNv0.23 Q5 K M
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.7 GB
QW
Qwen2.5 MFANN 7b Q8 0
Qwen · netcat420
Params7.62B
Context32K
Smallest8.1 GB
QW
Qwen2.5 7b MFANNv1.1 Q4 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest4.5 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA
DeepSeek · netcat420
Params8.19B
Context500K
Smallest4.8 GB