GGUF models by netcat420

231 GGUF models quantized by netcat420 on Hugging Face. Sizes run from 1.91B to 8.19B parameters. The longest trained context is 500K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
MFANN Llama3.1 Abliterated SLERP TIES V2 Q4 K S
Llama · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
QW
Qwen2.5 7b MFANN slerp Q4 0
Qwen · netcat420
Params7.62B
Context32K
Smallest4.4 GB
Tool use
QW
Qwen2.5 Coder Scholar 7B Abliterated MFANN Q6 K
Qwen · netcat420
Params7.62B
Context32K
Smallest6.3 GB
CodingTool use
MF
MFANN3bv1.1 Q4 K M
Mfann · netcat420
Params2.78B
Context128K
Q4_K_M1.7 GB
GGUF
MF
MFANNv0.24 Q5 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.6 GB
GGUF
QW
Qwen2.5 7b nerd uncensored MFANN slerp Q8 0
Qwen · netcat420
Params7.62B
Context32K
Smallest8.1 GB
Tool use
LL
MFANNv0.22 Q4 K M
Llama · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 7b nerd uncensored MFANN slerp Q6 K
Qwen · netcat420
Params7.62B
Context32K
Smallest6.3 GB
Tool use
LL
MFANN Llama3.1 Abliterated Slerp TIES Q8 0
Llama · netcat420
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MF
MFANN phigments slerp V3.3 Q5 K M
Mfann · netcat420
Params2.78B
Context2K
Smallest2.0 GB
GGUF
MF
MFANN3b Q5 K M
Mfann · netcat420
Params2.78B
Context128K
Smallest2.0 GB
GGUF
MF
MFANN3bv1.2 Q5 K M
Mfann · netcat420
Params2.78B
Context126K
Smallest2.0 GB
GGUF
QW
qwen2.5 MFANN 7b SLERP V1.3 Q4 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest4.5 GB
CodingTool use
MF
MFANN3bv0.8
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
GGUF
MH
MHENNcodemathv2
Mhenncodemathv · netcat420
Params7.24B
Context32K
Smallest4.4 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B KAYLA
DeepSeek · netcat420
Params8.19B
Context500K
Smallest8.7 GB
ReasoningTool use
LL
MFANNv0.23 Q4 K M
Llama · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MF
MFANNv0.24 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
LL
Llama3.1 MFANN 8b Q8 0
Llama · netcat420
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MF
MFANN3bv1.3 Q4 K M
Mfann · netcat420
Params2.78B
Context128K
Q4_K_M1.7 GB
GGUF
QW
Qwen2.5 7b MFANN slerp Q5 K M
Qwen · netcat420
Params7.62B
Context32K
Smallest5.4 GB
Tool use
MF
MFANNv0.10
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
GGUF
MH
MHENN4
Mhenn · netcat420
Params7.24B
Context32K
Smallest4.4 GB
GGUF
MF
MFANNv0.22.1 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
MF
MFANN3b Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.17
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B KAYLA
DeepSeek · netcat420
Params8.19B
Context500K
Smallest6.7 GB
ReasoningTool use
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · netcat420
Params8.19B
Context500K
Smallest4.8 GB
ReasoningTool use
MF
MFANNv0.25 Q5 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.6 GB
GGUF
QW
qwen2.5 MFANN 7b SLERP V1.3 Q4 0
Qwen · netcat420
Params7.62B
Context32K
Smallest4.4 GB
CodingTool use

Keep browsing