GGUF models by netcat420

231 GGUF models quantized by netcat420 on Hugging Face. Sizes run from 1.91B to 8.19B parameters. The longest trained context is 500K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
MFANN Llama3.1 Abliterated Slerp TIES Q5 K S
Llama · netcat420
Params8.03B
Context128K
Smallest5.6 GB
GGUF
MF
MFANNv0.25 Q8 0
Mfannv · netcat420
Params8.03B
Context128K
Smallest8.5 GB
GGUF
QW
Qwen2.5 MFANN 7b Q4 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest4.5 GB
Tool use
QW
Qwen2.5 MFANN 7b Q4 K M
Qwen · netcat420
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
MF
MFANN3bv1.1 Q8 0
Mfann · netcat420
Params2.78B
Context128K
Smallest3.0 GB
GGUF
MF
MFANN3bv1.1 Q6 K
Mfann · netcat420
Params2.78B
Context128K
Smallest2.3 GB
GGUF
MF
MFANNv0.7
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
GGUF
MF
MFANNv0.13
Mfannv · netcat420
Params8.03B
Context32K
Smallest4.9 GB
GGUF
MF
MFANN3bv0.14
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.22 Q5 K S
Mfann · netcat420
Params2.78B
Context32K
Smallest1.9 GB
GGUF
MF
MFANNv0.23 Q8 0
Mfannv · netcat420
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MF
MFANN3bv0.23 Q5 0
Mfann · netcat420
Params2.78B
Context128K
Smallest1.9 GB
GGUF
MF
MFANN3bv0.5
Mfann · netcat420
Params2.78B
Context2K
Smallest1.7 GB
GGUF
MF
MFANNv0.17
Mfannv · netcat420
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
MF
MFANN3bv0.4
Mfann · netcat420
Params2.78B
Context2K
Smallest1.7 GB
GGUF
MF
MFANNv0.9
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
GGUF
MF
MFANNv0.15
Mfannv · netcat420
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
MF
MFANNv0.16
Mfannv · netcat420
Params8.03B
Context32K
Smallest4.9 GB
GGUF
MF
MFANN3bv0.23 Q5 K M
Mfann · netcat420
Params2.78B
Context128K
Smallest2.0 GB
GGUF
MF
MFANN3bv1.1 Q4 K S
Mfann · netcat420
Params2.78B
Context128K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.23 Q6 K
Mfann · netcat420
Params2.78B
Context128K
Smallest2.3 GB
GGUF

Keep browsing