GGUF models by ZeroXClem
146 GGUF models quantized by ZeroXClem on Hugging Face. Sizes run from 2.03B to 8.95B parameters. The longest trained context is 986K tokens.
SA
L3SAO Mix SuperHermes NovaPurosani 8B Q4 K S
Sao · ZeroXClem
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3 Aetheric Hermes Lexi Smaug 8B Q5 K S
Llama · ZeroXClem
Params8.03B
Context8K
Smallest5.6 GB
SA
L3SAO Mix SuperHermes NovaPurosani 8B Q4 K M
Sao · ZeroXClem
Params8.03B
Context128K
Q4_K_M4.9 GB
AS
Astral Fusion Neural Happy L3.1 8B Q5 K M
Astral · ZeroXClem
Params8.03B
Context8K
Smallest5.7 GB
LL
Llama 3 Yggdrasil AstralSpice 8B Q5 K S
Llama · ZeroXClem
Params8.03B
Context8K
Smallest5.6 GB
MI
Mistral 2.5 Prima Hercules Fusion 7B Q5 K M
Mistral · ZeroXClem
Params7.24B
Context32K
Smallest5.1 GB
SA
L3SAO Mix SuperHermes NovaPurosani 8B Q4 0
Sao · ZeroXClem
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama 3 Yggdrasil AstralSpice 8B Q6 K
Llama · ZeroXClem
Params8.03B
Context8K
Smallest6.6 GB
LL
Llama 3 Aetheric Hermes Lexi Smaug 8B Q4 K S
Llama · ZeroXClem
Params8.03B
Context8K
Smallest4.7 GB
QW
Qwen3 4B Hermes Axion Pro
Qwen · ZeroXClem
Params4.02B
Context256K
Smallest3.3 GB
LL
Llama 3 Aetheric Hermes Lexi Smaug 8B Q6 K
Llama · ZeroXClem
Params8.03B
Context8K
Smallest6.6 GB
SA
L3SAO Mix SuperHermes NovaPurosani 8B Q8 0
Sao · ZeroXClem
Params8.03B
Context128K
Smallest8.5 GB
AS
L3 Aspire Heart Matrix 8B Q4 0
Aspire · ZeroXClem
Params8.03B
Context8K
Smallest4.7 GB
LL
LLama3.1 Hawkish Theia Fireball 8B Q6 K
Llama · ZeroXClem
Params8.03B
Context128K
Smallest6.6 GB
LL
Llama 3.1 8B SuperNova EtherealHermes Q4 K M
Llama · ZeroXClem
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 4B CrystalSonic
Qwen · ZeroXClem
Params4.02B
Context256K
Smallest3.3 GB
QW
Qwen 2.5 Aether SlerpFusion 7B Q8 0
Qwen · ZeroXClem
Params7.62B
Context128K
Smallest8.1 GB
LL
LLama3.1 Hawkish Theia Fireball 8B Q4 K M
Llama · ZeroXClem
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 4B Hermes Axion Pro
Qwen · ZeroXClem
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 8B HoneyBadger EXP
Qwen · ZeroXClem
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen 2.5 Aether SlerpFusion 7B Q5 K M
Qwen · ZeroXClem
Params7.62B
Context128K
Smallest5.4 GB
MI
Mistral 2.5 Prima Hercules Fusion 7B Q8 0
Mistral · ZeroXClem
Params7.24B
Context32K
Smallest7.7 GB
QW
Qwen2.5 7B CelestialHarmony 1M Q4 K M
Qwen · ZeroXClem
Params7.61B
Context986K
Q4_K_M4.7 GB
QW
Qwen2.5 7B
Qwen · ZeroXClem
Params7.62B
Context128K
Smallest5.3 GB
LL
Llama 3.1 8B SpecialTitanFusion Q4 K M
Llama · ZeroXClem
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen 2.5 Aether SlerpFusion 7B Q4 K M
Qwen · ZeroXClem
Params7.62B
Context128K
Q4_K_M4.7 GB