GGUF models by netcat420
231 GGUF models quantized by netcat420 on Hugging Face. Sizes run from 1.91B to 8.19B parameters. The longest trained context is 500K tokens.
LL
MFANN Llama3.1 Abliterated SLERP TIES V2 Q4 K S
Llama · netcat420
Params8.03B
Context128K
Smallest4.7 GB
QW
Qwen2.5 7b MFANN slerp Q4 0
Qwen · netcat420
Params7.62B
Context32K
Smallest4.4 GB
QW
Qwen2.5 Coder Scholar 7B Abliterated MFANN Q6 K
Qwen · netcat420
Params7.62B
Context32K
Smallest6.3 GB
MF
MFANN3bv1.1 Q4 K M
Mfann · netcat420
Params2.78B
Context128K
Q4_K_M1.7 GB
MF
MFANNv0.24 Q5 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.6 GB
QW
Qwen2.5 7b nerd uncensored MFANN slerp Q8 0
Qwen · netcat420
Params7.62B
Context32K
Smallest8.1 GB
LL
MFANNv0.22 Q4 K M
Llama · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 7b nerd uncensored MFANN slerp Q6 K
Qwen · netcat420
Params7.62B
Context32K
Smallest6.3 GB
LL
MFANN Llama3.1 Abliterated Slerp TIES Q8 0
Llama · netcat420
Params8.03B
Context128K
Smallest8.5 GB
MF
MFANN phigments slerp V3.3 Q5 K M
Mfann · netcat420
Params2.78B
Context2K
Smallest2.0 GB
MF
MFANN3b Q5 K M
Mfann · netcat420
Params2.78B
Context128K
Smallest2.0 GB
MF
MFANN3bv1.2 Q5 K M
Mfann · netcat420
Params2.78B
Context126K
Smallest2.0 GB
QW
qwen2.5 MFANN 7b SLERP V1.3 Q4 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest4.5 GB
MF
MFANN3bv0.8
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
MH
MHENNcodemathv2
Mhenncodemathv · netcat420
Params7.24B
Context32K
Smallest4.4 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA
DeepSeek · netcat420
Params8.19B
Context500K
Smallest8.7 GB
LL
MFANNv0.23 Q4 K M
Llama · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANNv0.24 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama3.1 MFANN 8b Q8 0
Llama · netcat420
Params8.03B
Context128K
Smallest8.5 GB
MF
MFANN3bv1.3 Q4 K M
Mfann · netcat420
Params2.78B
Context128K
Q4_K_M1.7 GB
QW
Qwen2.5 7b MFANN slerp Q5 K M
Qwen · netcat420
Params7.62B
Context32K
Smallest5.4 GB
MF
MFANNv0.10
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
MH
MHENN4
Mhenn · netcat420
Params7.24B
Context32K
Smallest4.4 GB
MF
MFANNv0.22.1 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
MF
MFANN3b Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
MF
MFANN3bv0.17
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA
DeepSeek · netcat420
Params8.19B
Context500K
Smallest6.7 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · netcat420
Params8.19B
Context500K
Smallest4.8 GB
MF
MFANNv0.25 Q5 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.6 GB
QW
qwen2.5 MFANN 7b SLERP V1.3 Q4 0
Qwen · netcat420
Params7.62B
Context32K
Smallest4.4 GB