GGUF models by netcat420
231 GGUF models quantized by netcat420 on Hugging Face. Sizes run from 1.91B to 8.19B parameters. The longest trained context is 500K tokens.
LL
MFANN llama3.1 abliterated SLERP v3.1 Q5 K M
Llama · netcat420
Params8.03B
Context128K
Smallest5.7 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · netcat420
Params8.19B
Context500K
Q4_K_M5.0 GB
MF
MFANN3bv0.23 Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
MF
MFANN3bv0.24 Q5 K M
Mfann · netcat420
Params2.78B
Context128K
Smallest2.0 GB
MF
MFANNv0.8
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
LL
MFANN Llama3.1 Abliterated SLERP TIES V3 Q5 K M
Llama · netcat420
Params8.03B
Context128K
Smallest5.7 GB
MF
MFANN Phigments Slerp V4 BETA1
Mfann · netcat420
Params2.78B
Context500K
Q4_K_M1.7 GB
MF
MFANN3bv0.22 Q5 K M
Mfann · netcat420
Params2.78B
Context32K
Smallest2.0 GB
MF
MFANNv0.22.1 Q6 K
Mfannv · netcat420
Params8.03B
Context128K
Smallest6.6 GB
LL
MFANN Llama3.1 Abliterated SLERP TIES V2 Q5 K M
Llama · netcat420
Params8.03B
Context128K
Smallest5.7 GB
DE
Qwen2.5 DeepSeek R1 MFANN 7b Q4 K M
DeepSeek · netcat420
Params7.62B
Context4K
Q4_K_M4.7 GB
QW
qwen2.5 MFANN 7b SLERP V1.4 Q4 0
Qwen · netcat420
Params7.62B
Context32K
Smallest4.4 GB
QW
Qwen2.5 MFANN 7b SLERP V2 BETA1 512k
Qwen · netcat420
Params7.62B
Context500K
Smallest4.4 GB
LL
MFANNv0.22 Q4 K S
Llama · netcat420
Params8.03B
Context128K
Smallest4.7 GB
MF
MFANN3bv1.1 Q5 K M
Mfann · netcat420
Params2.78B
Context128K
Smallest2.0 GB
QW
Qwen2.5 7b MFANN slerp Q6 K
Qwen · netcat420
Params7.62B
Context32K
Smallest6.3 GB
LL
Llama3.1 MFANN 8b Q4 K S
Llama · netcat420
Params8.03B
Context128K
Smallest4.7 GB
QW
Qwen3 1.7b MFANN Slerp
Qwen · netcat420
Params1.91B
Context40K
Smallest1.2 GB
MF
MFANN3bv1.2 Q5 K S
Mfann · netcat420
Params2.78B
Context126K
Smallest1.9 GB
QW
Qwen2.5 MFANN 7b Q6 K
Qwen · netcat420
Params7.62B
Context32K
Smallest6.3 GB
LL
MFANN llama3.1 abliterated SLERP v3.1 Q5 K S
Llama · netcat420
Params8.03B
Context128K
Smallest5.6 GB
LL
MFANN Llama3.1 Abliterated SLERP TIES V2 Q5 K S
Llama · netcat420
Params8.03B
Context128K
Smallest5.6 GB
MF
MFANN3bv0.24 Q5 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.9 GB
QW
Qwen2.5 MFANN 7b Q5 0
Qwen · netcat420
Params7.62B
Context32K
Smallest5.3 GB
MF
MFANNv0.25 Q5 K M
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.7 GB
MF
MFANN Phigments Slerp V4 BETA1
Mfann · netcat420
Params2.78B
Context500K
Smallest1.6 GB
LL
MFANN Llama3.1 Abliterated SLERP TIES V2 Q8 0
Llama · netcat420
Params8.03B
Context128K
Smallest8.5 GB
MF
MFANNv0.25 Q6 K
Mfannv · netcat420
Params8.03B
Context128K
Smallest6.6 GB
MF
MFANN3bv1.2 Q8 0
Mfann · netcat420
Params2.78B
Context126K
Smallest3.0 GB
QW
qwen2.5 MFANN 7b SLERP V1.4 Q4 K M
Qwen · netcat420
Params7.62B
Context32K
Q4_K_M4.7 GB