GGUF models by netcat420

231 GGUF models quantized by netcat420 on Hugging Face. Sizes run from 1.91B to 8.19B parameters. The longest trained context is 500K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
MFANN llama3.1 abliterated SLERP v3.1 Q5 K M
Llama · netcat420
Params8.03B
Context128K
Smallest5.7 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · netcat420
Params8.19B
Context500K
Q4_K_M5.0 GB
ReasoningTool use
MF
MFANN3bv0.23 Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.24 Q5 K M
Mfann · netcat420
Params2.78B
Context128K
Smallest2.0 GB
GGUF
MF
MFANNv0.8
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
GGUF
LL
MFANN Llama3.1 Abliterated SLERP TIES V3 Q5 K M
Llama · netcat420
Params8.03B
Context128K
Smallest5.7 GB
GGUF
MF
MFANN Phigments Slerp V4 BETA1
Mfann · netcat420
Params2.78B
Context500K
Q4_K_M1.7 GB
GGUF
MF
MFANN3bv0.22 Q5 K M
Mfann · netcat420
Params2.78B
Context32K
Smallest2.0 GB
GGUF
MF
MFANNv0.22.1 Q6 K
Mfannv · netcat420
Params8.03B
Context128K
Smallest6.6 GB
GGUF
LL
MFANN Llama3.1 Abliterated SLERP TIES V2 Q5 K M
Llama · netcat420
Params8.03B
Context128K
Smallest5.7 GB
GGUF
DE
Qwen2.5 DeepSeek R1 MFANN 7b Q4 K M
DeepSeek · netcat420
Params7.62B
Context4K
Q4_K_M4.7 GB
ReasoningTool use
QW
qwen2.5 MFANN 7b SLERP V1.4 Q4 0
Qwen · netcat420
Params7.62B
Context32K
Smallest4.4 GB
Tool use
QW
Qwen2.5 MFANN 7b SLERP V2 BETA1 512k
Qwen · netcat420
Params7.62B
Context500K
Smallest4.4 GB
CodingTool use
LL
MFANNv0.22 Q4 K S
Llama · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
MF
MFANN3bv1.1 Q5 K M
Mfann · netcat420
Params2.78B
Context128K
Smallest2.0 GB
GGUF
QW
Qwen2.5 7b MFANN slerp Q6 K
Qwen · netcat420
Params7.62B
Context32K
Smallest6.3 GB
Tool use
LL
Llama3.1 MFANN 8b Q4 K S
Llama · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
QW
Qwen3 1.7b MFANN Slerp
Qwen · netcat420
Params1.91B
Context40K
Smallest1.2 GB
ReasoningTool use
MF
MFANN3bv1.2 Q5 K S
Mfann · netcat420
Params2.78B
Context126K
Smallest1.9 GB
GGUF
QW
Qwen2.5 MFANN 7b Q6 K
Qwen · netcat420
Params7.62B
Context32K
Smallest6.3 GB
Tool use
LL
MFANN llama3.1 abliterated SLERP v3.1 Q5 K S
Llama · netcat420
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
MFANN Llama3.1 Abliterated SLERP TIES V2 Q5 K S
Llama · netcat420
Params8.03B
Context128K
Smallest5.6 GB
GGUF
MF
MFANN3bv0.24 Q5 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.9 GB
GGUF
QW
Qwen2.5 MFANN 7b Q5 0
Qwen · netcat420
Params7.62B
Context32K
Smallest5.3 GB
Tool use
MF
MFANNv0.25 Q5 K M
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.7 GB
GGUF
MF
MFANN Phigments Slerp V4 BETA1
Mfann · netcat420
Params2.78B
Context500K
Smallest1.6 GB
GGUF
LL
MFANN Llama3.1 Abliterated SLERP TIES V2 Q8 0
Llama · netcat420
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MF
MFANNv0.25 Q6 K
Mfannv · netcat420
Params8.03B
Context128K
Smallest6.6 GB
GGUF
MF
MFANN3bv1.2 Q8 0
Mfann · netcat420
Params2.78B
Context126K
Smallest3.0 GB
GGUF
QW
qwen2.5 MFANN 7b SLERP V1.4 Q4 K M
Qwen · netcat420
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use

Keep browsing