GGUF models by netcat420
231 GGUF models quantized by netcat420 on Hugging Face. Sizes run from 1.91B to 8.19B parameters. The longest trained context is 500K tokens.
MF
MFANN3bv0.23 Q4 K M
Mfann · netcat420
Params2.78B
Context128K
Q4_K_M1.7 GB
MF
MFANN3bv0.16
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN phigments slerp V3.3 Q5 K S
Mfann · netcat420
Params2.78B
Context2K
Smallest1.9 GB
MF
MFANN3bv0.2
Mfann · netcat420
Params2.78B
Context2K
Smallest1.7 GB
LL
Llama3.1 MFANN 8b Q4 K M
Llama · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 1.7b MFANN Slerp
Qwen · netcat420
Params1.91B
Context40K
Q4_K_M1.2 GB
MF
MFANNv0.22.1 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANN3bv0.24 Q8 0
Mfann · netcat420
Params2.78B
Context128K
Smallest3.0 GB
LL
Llama3.1 MFANN 8b Q6 K
Llama · netcat420
Params8.03B
Context128K
Smallest6.6 GB
MF
MFANN3bv1.3 Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
MF
MFANNv0.19 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
MFANN Llama3.1 Abliterated SLERP TIES V3 Q4 K S
Llama · netcat420
Params8.03B
Context128K
Smallest4.7 GB
MF
MFANN phigments slerp V3.4 Q4 K S
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
MF
MFANN3bv0.20
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN3bv0.24 Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
LL
MFANN Llama3.1 Abliterated SLERP TIES V3 Q4 K M
Llama · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
MF
MFANN3bv0.22 Q4 K S
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANNv0.12
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.9 GB
MF
MFANN3bv1.2 Q5 0
Mfann · netcat420
Params2.78B
Context126K
Smallest1.9 GB
MF
MFANNv0.24 Q6 K
Mfannv · netcat420
Params8.03B
Context128K
Smallest6.6 GB
MF
MFANNv0.2
Mfannv · netcat420
Params7.24B
Context32K
Smallest4.4 GB
MF
MFANN3bv0.9
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
MF
MFANNv0.18 Q4 K M
Mfannv · netcat420
Params8.03B
Context32K
Q4_K_M4.9 GB
LL
MFANNv0.23 Q4 K S
Llama · netcat420
Params8.03B
Context128K
Smallest4.7 GB
QW
Qwen2.5 MFANN 7b Q5 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest5.3 GB
MF
MFANN Phigments Slerp V4 BETA1
Mfann · netcat420
Params2.78B
Context500K
Smallest1.6 GB
DE
DeepSeek R1 0528 Qwen3 8B KAYLA1.1
DeepSeek · netcat420
Params8.19B
Context500K
Smallest6.7 GB
LL
MFANN Llama3.1 Abliterated SLERP TIES V3 Q5 K S
Llama · netcat420
Params8.03B
Context128K
Smallest5.6 GB
QW
Qwen3 1.7b MFANN Slerp
Qwen · netcat420
Params1.91B
Context40K
Smallest1.2 GB
MF
MFANNv0.3
Mfannv · netcat420
Params7.24B
Context32K
Smallest4.4 GB