GGUF models by netcat420

231 GGUF models quantized by netcat420 on Hugging Face. Sizes run from 1.91B to 8.19B parameters. The longest trained context is 500K tokens.

Most downloadedNewestLargestLongest contextSmallest
MF
MFANN3bv0.13
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
GGUF
MF
MFANNv0.23 Q5 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest5.6 GB
GGUF
QW
qwen2.5 MFANN 7b SLERP V1.4 Q4 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest4.5 GB
Tool use
MF
MFANN phigments slerp V3.4 Q4 0
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
GGUF
LL
Llama3.1 MFANN 8b Q5 K M
Llama · netcat420
Params8.03B
Context128K
Smallest5.7 GB
GGUF
MF
MFANNv0.25 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MF
MFANN3bv0.23 Q8 0
Mfann · netcat420
Params2.78B
Context128K
Smallest3.0 GB
GGUF
QW
qwen2.5 MFANN 7b SLERP V1.3 Q4 K M
Qwen · netcat420
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
MF
MFANNv0.21 Q4 K S
Mfannv · netcat420
Params8.03B
Context128K
Smallest4.7 GB
GGUF
MF
MFANN3bv0.11
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
GGUF
MH
MHENN3.5
Mhenn · netcat420
Params7.24B
Context32K
Smallest4.4 GB
GGUF
MF
MFANNv0.24 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 7b MFANN slerp Q5 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest5.3 GB
Tool use
DE
Qwen2.5 DeepSeek R1 MFANN 7b Q5 0
DeepSeek · netcat420
Params7.62B
Context4K
Smallest5.3 GB
ReasoningTool use
MF
MFANN3bv0.15
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
GGUF
MF
MFANNv0.21 Q4 K M
Mfannv · netcat420
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MF
MFANNv0.6
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
GGUF
MF
MFANN3bv0.18
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
GGUF
MF
MFANN3bv1.2 Q4 K M
Mfann · netcat420
Params2.78B
Context126K
Q4_K_M1.7 GB
GGUF
MF
MFANNv0.14
Mfannv · netcat420
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
MF
MFANN3bv1.2 Q6 K
Mfann · netcat420
Params2.78B
Context126K
Smallest2.3 GB
GGUF
QW
qwen2.5 MFANN 7b SLERP V1.2 Q4 K S
Qwen · netcat420
Params7.62B
Context32K
Smallest4.5 GB
CodingTool use
MF
MFANN3bv0.8.10
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.19
Mfann · netcat420
Params2.78B
Context32K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.1
Mfann · netcat420
Params3.43B
Context2K
Smallest2.0 GB
GGUF
MF
MFANNv0.4
Mfannv · netcat420
Params7.24B
Context32K
Smallest4.4 GB
GGUF
MF
MFANN3bv0.3
Mfann · netcat420
Params2.78B
Context2K
Smallest1.7 GB
GGUF
MF
MFANNv0.8 GGUF DEFUNCT
Mfannv · netcat420
Params8.03B
Context8K
Smallest4.7 GB
GGUF
MF
MFANN3bv0.10
Mfann · netcat420
Params2.78B
Context2K
Smallest1.6 GB
GGUF
MF
MFANN3bv0.22 Q4 K M
Mfann · netcat420
Params2.78B
Context32K
Q4_K_M1.7 GB
GGUF

Keep browsing