GGUF models by netcat420
231 GGUF models quantized by netcat420 on Hugging Face. Sizes run from 1.91B to 8.19B parameters. The longest trained context is 500K tokens.
LL
MFANN Llama3.1 Abliterated Slerp TIES Q5 K S
Llama · netcat420
Params8.03B
Context128K
Smallest5.6 GB
MF
MFANNv0.25 Q8 0
Mfannv · netcat420
Params8.03B
Context128K
Smallest8.5 GB
QW
Qwen2.5 MFANN 7b Q4 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest4.5 GB
QW
Qwen2.5 MFANN 7b Q4 K M
Qwen · netcat420
Params7.62B
Context32K
Q4_K_M4.7 GB
MF
MFANN3bv1.1 Q8 0
Mfann · netcat420
Params2.78B
Context128K
Smallest3.0 GB
MF
MFANN3bv1.1 Q6 K
Mfann · netcat420
Params2.78B
Context128K
Smallest2.3 GB
MF
MFANNv0.7
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
MF
MFANNv0.13
Mfannv · netcat420
Params8.03B
Context32K
Smallest4.9 GB
MF
MFANN3bv0.14
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
MF
MFANN3bv0.22 Q5 K S
Mfann · netcat420
Params2.78B
Context32K
Smallest1.9 GB
MF
MFANNv0.23 Q8 0
Mfannv · netcat420
Params8.03B
Context128K
Smallest8.5 GB
MF
MFANN3bv0.23 Q5 0
Mfann · netcat420
Params2.78B
Context128K
Smallest1.9 GB
MF
MFANN3bv0.5
Mfann · netcat420
Params2.78B
Context2K
Smallest1.7 GB
MF
MFANNv0.17
Mfannv · netcat420
Params8.03B
Context32K
Q4_K_M4.9 GB
MF
MFANN3bv0.4
Mfann · netcat420
Params2.78B
Context2K
Smallest1.7 GB
MF
MFANNv0.9
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
MF
MFANNv0.15
Mfannv · netcat420
Params8.03B
Context32K
Q4_K_M4.9 GB
MF
MFANNv0.16
Mfannv · netcat420
Params8.03B
Context32K
Smallest4.9 GB
MF
MFANN3bv0.23 Q5 K M
Mfann · netcat420
Params2.78B
Context128K
Smallest2.0 GB
MF
MFANN3bv1.1 Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
MF
MFANN3bv0.23 Q6 K
Mfann · netcat420
Params2.78B
Context128K
Smallest2.3 GB