GGUF models by ZeroXClem
146 GGUF models quantized by ZeroXClem on Hugging Face. Sizes run from 2.03B to 8.95B parameters. The longest trained context is 986K tokens.
QW
Qwen3 4B Sky High Hermes
Qwen · ZeroXClem
Params4.02B
Context256K
Smallest4.3 GB
LL
Llama3.1 BestMix Chem Einstein 8B Q4 K M
Llama · ZeroXClem
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.1 BestMix Chem Einstein 8B Q5 0
Llama · ZeroXClem
Params8.03B
Context128K
Smallest5.6 GB
AS
L3 Aspire Heart Matrix 8B Q5 0
Aspire · ZeroXClem
Params8.03B
Context8K
Smallest5.6 GB
QW
Qwen2.5 7B HomerCreative Mix Q4 K M
Qwen · ZeroXClem
Params7.62B
Context32K
Q4_K_M4.7 GB
ST
Stheno Hercules 3.1 8B Q5 0
Stheno · ZeroXClem
Params8.03B
Context128K
Smallest5.6 GB
QW
Qwen2.5 7B HomerCreative Mix Q4 0
Qwen · ZeroXClem
Params7.62B
Context32K
Smallest4.4 GB
QW
Qwen3 4B Sky High Hermes
Qwen · ZeroXClem
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 4B ChromaticCoder
Qwen · ZeroXClem
Params4.02B
Context40K
Q4_K_M2.5 GB
QW
Qwen2.5 7B
Qwen · ZeroXClem
Params7.62B
Context128K
Smallest6.3 GB
LL
Llama3.1 BestMix Chem Einstein 8B Q4 0
Llama · ZeroXClem
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama3.1 DarkStorm Aspire 8B Q8 0
Llama · ZeroXClem
Params8.03B
Context128K
Smallest8.5 GB
QW
Qwen2.5 7B HomerAnvita NerdMix Q4 K M
Qwen · ZeroXClem
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama 3 Aetheric Hermes Lexi Smaug 8B Q5 K M
Llama · ZeroXClem
Params8.03B
Context8K
Smallest5.7 GB
LL
Llama 3.1 8B SuperTulu LexiNova Q5 0
Llama · ZeroXClem
Params8.03B
Context128K
Smallest5.6 GB
QW
Qwen2.5 7B HomerAnvita NerdMix Q6 K
Qwen · ZeroXClem
Params7.62B
Context32K
Smallest6.3 GB
LL
Llama3.1 BestMix Chem Einstein 8B Q8 0
Llama · ZeroXClem
Params8.03B
Context128K
Smallest8.5 GB
QW
Qwen2.5 7B HomerAnvita NerdMix Q5 0
Qwen · ZeroXClem
Params7.62B
Context32K
Smallest5.3 GB
LL
Llama3.1 TheiaFire DarkFusion 8B Q8 0
Llama · ZeroXClem
Params8.03B
Context128K
Smallest8.5 GB
QW
Qwen3 4B ChromaticCoder
Qwen · ZeroXClem
Params4.02B
Context40K
Smallest2.8 GB
LL
Llama 3 Aetheric Hermes Lexi Smaug 8B Q8 0
Llama · ZeroXClem
Params8.03B
Context8K
Smallest8.5 GB
LL
Llama 3.1 8B Athena Apollo exp Q4 K M
Llama · ZeroXClem
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B SuperTulu LexiNova Q8 0
Llama · ZeroXClem
Params8.03B
Context128K
Smallest8.5 GB
QW
Qwen2.5 7B
Qwen · ZeroXClem
Params7.62B
Context128K
Smallest4.4 GB
LL
Llama3.1 DarkStorm Aspire 8B Q5 K M
Llama · ZeroXClem
Params8.03B
Context128K
Smallest5.7 GB
QW
Qwen3 1.7B TardigradePro
Qwen · ZeroXClem
Params2.03B
Context32K
Smallest1.7 GB
PN
L3.1 Pneuma Allades 8B Q4 0
Pneuma · ZeroXClem
Params8.03B
Context128K
Smallest4.7 GB
LL
LLama3.1 Hawkish Theia Fireball 8B Q5 0
Llama · ZeroXClem
Params8.03B
Context128K
Smallest5.6 GB
LL
Llama3.1 DarkStorm Aspire 8B Q5 0
Llama · ZeroXClem
Params8.03B
Context128K
Smallest5.6 GB
AS
L3 Aspire Heart Matrix 8B Q4 K M
Aspire · ZeroXClem
Params8.03B
Context8K
Q4_K_M4.9 GB