GGUF models by ZeroXClem
146 GGUF models quantized by ZeroXClem on Hugging Face. Sizes run from 2.03B to 8.95B parameters. The longest trained context is 986K tokens.
LL
Llama3.1 TheiaFire DarkFusion 8B Q6 K
Llama · ZeroXClem
Params8.03B
Context128K
Smallest6.6 GB
QW
Qwen3 1.7B TardigradePro
Qwen · ZeroXClem
Params2.03B
Context32K
Q4_K_M1.3 GB
QW
Qwen2.5 7B HomerAnvita NerdMix Q8 0
Qwen · ZeroXClem
Params7.62B
Context32K
Smallest8.1 GB
LL
Llama3.1 8B Titanium Forge Q8 0
Llama · ZeroXClem
Params8.03B
Context128K
Smallest8.5 GB
AS
L3 Aspire Heart Matrix 8B Q6 K
Aspire · ZeroXClem
Params8.03B
Context8K
Smallest6.6 GB
LL
Llama3.1 TheiaFire DarkFusion 8B Q5 K S
Llama · ZeroXClem
Params8.03B
Context128K
Smallest5.6 GB
AS
Astral Fusion Neural Happy L3.1 8B Q4 K S
Astral · ZeroXClem
Params8.03B
Context8K
Smallest4.7 GB
LL
Llama 3 Aetheric Hermes Lexi Smaug 8B Q4 K M
Llama · ZeroXClem
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
L3.1 Purosani 2 8B
Llama · ZeroXClem
Params8.03B
Context128K
Smallest5.7 GB
LL
Llama3.1 8B Titanium Forge Q5 0
Llama · ZeroXClem
Params8.03B
Context128K
Smallest5.6 GB
LL
Llama3.1 DarkStorm Aspire 8B Q4 K S
Llama · ZeroXClem
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama3.1 8B Titanium Forge Q4 K S
Llama · ZeroXClem
Params8.03B
Context128K
Smallest4.7 GB
LL
Llama3.1 DarkStorm Aspire 8B Q6 K
Llama · ZeroXClem
Params8.03B
Context128K
Smallest6.6 GB
QW
Qwen3 4B ChromaticCoder
Qwen · ZeroXClem
Params4.02B
Context40K
Smallest3.3 GB
SA
L3SAO Mix SuperHermes NovaPurosani 8B Q5 0
Sao · ZeroXClem
Params8.03B
Context128K
Smallest5.6 GB
QW
Qwen3 4B Valiant Polaris
Qwen · ZeroXClem
Params4.02B
Context40K
Q4_K_M2.5 GB
MI
Mistral 2.5 Prima Hercules Fusion 7B Q4 K M
Mistral · ZeroXClem
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 7B HomerAnvita NerdMix Q5 K M
Qwen · ZeroXClem
Params7.62B
Context32K
Smallest5.4 GB
LL
Llama 3.1 8B AthenaSky MegaMix Q4 K M
Llama · ZeroXClem
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 Aetheric Hermes Lexi Smaug 8B Q4 0
Llama · ZeroXClem
Params8.03B
Context8K
Smallest4.7 GB
QW
Qwen2.5 7B
Qwen · ZeroXClem
Params7.62B
Context128K
Smallest8.1 GB
LL
Llama 3 Aetheric Hermes Lexi Smaug 8B Q5 0
Llama · ZeroXClem
Params8.03B
Context8K
Smallest5.6 GB
QW
Qwen2.5 7B
Qwen · ZeroXClem
Params7.62B
Context128K
Smallest4.5 GB
QW
Qwen 2.5 Aether SlerpFusion 7B Q6 K
Qwen · ZeroXClem
Params7.62B
Context128K
Smallest6.3 GB
MI
Mistral 2.5 Prima Hercules Fusion 7B Q6 K
Mistral · ZeroXClem
Params7.24B
Context32K
Smallest5.9 GB
LL
L3.1 Purosani 2 8B
Llama · ZeroXClem
Params8.03B
Context128K
Smallest4.7 GB
GE
Gemma3 4B Arceus Servant
Gemma · ZeroXClem
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
Llama3.1 DarkStorm Aspire 8B Q5 K S
Llama · ZeroXClem
Params8.03B
Context128K
Smallest5.6 GB
LL
Llama3.1 DarkStorm Aspire 8B Q4 K M
Llama · ZeroXClem
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 4B MiniMight
Qwen · ZeroXClem
Params4.41B
Context256K
Smallest3.6 GB