GGUF models by AbteeXAILab
71 GGUF models quantized by AbteeXAILab on Hugging Face. Sizes run from 135M to 671B parameters. The longest trained context is 1024K tokens.
DE
lumynax reasoning deepseek r1 qwen 15b
DeepSeek · AbteeXAILab
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
lumynax reasoning deepseek distill text
DeepSeek · AbteeXAILab
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
lumynax frontier qwen3 235b a22b instruct
Qwen · AbteeXAILab
Params235B
Context256K
Q4_K_M142.2 GB
QW
lumynax reasoning qwq 32b
Qwen · AbteeXAILab
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
lumynax infused qwen3 text
Qwen · AbteeXAILab
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen2.5 72B Instruct
Qwen · AbteeXAILab
Params72.7B
Context32K
Q4_K_M47.4 GB
YI
lumynax chat yi 15 34b
Yi · AbteeXAILab
Params34.4B
Context4K
Q4_K_M20.7 GB
GE
lumynax infused gemma4 26b a4b
Gemma · AbteeXAILab
Params25.2B
Context256K
Q4_K_M16.9 GB
MO
lumynax moe moonlight 16b a3b
Moonlight · AbteeXAILab
Params16B
Context8K
Smallest8.7 GB
GR
lumynax infused granite31 1b a400m
Granite · AbteeXAILab
Params1.33B
Context128K
Q4_K_M0.8 GB
GR
lumynax infused granite33 2b
Granite · AbteeXAILab
Params2.53B
Context128K
Q4_K_M1.5 GB
DB
lumynax frontier dbrx instruct 132b
Dbrx · AbteeXAILab
Params132B
Context32K
Smallest47.9 GB
MI
lumynax infused mistral 7b v03
Mistral · AbteeXAILab
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
qwen2.5-7b-instruct
Qwen · AbteeXAILab
Params7.62B
Context128K
Smallest3.8 GB
SM
lumynax infused smollm2 17b
SmolLM · AbteeXAILab
Params1.71B
Context8K
Q4_K_M1.1 GB
MI
lumynax frontier mixtral 8x22b instruct
Mistral · AbteeXAILab
Params141B
Context64K
Q4_K_M85.6 GB
PH
Phi 4 Mini Instruct
Phi · AbteeXAILab
Params3.84B
Context128K
Q4_K_M2.5 GB
PH
lumynax frontier phi 4 14b
Phi · AbteeXAILab
Params14.7B
Context16K
Q4_K_M8.9 GB
CO
lumynax coder yi coder 9b
Coder · AbteeXAILab
Params8.83B
Context128K
Q4_K_M5.3 GB
PH
lumynax infused phi3 mini 4k
Phi · AbteeXAILab
Params3.82B
Context4K
Smallest2.4 GB
OL
lumynax infused olmo2 7b 1124
OLMo · AbteeXAILab
Params7.3B
Context4K
Q4_K_M4.5 GB
QW
lumynax frontier coder qwen3 480b a35b
Qwen · AbteeXAILab
Params480B
Context256K
Q4_K_M290.1 GB
DE
lumynax reasoning deepseek r1 qwen 7b
DeepSeek · AbteeXAILab
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek V2.5 1210
DeepSeek · AbteeXAILab
Params236B
Context160K
Q4_K_M142.5 GB
QW
qwen2.5-1.5b-instruct
Qwen · AbteeXAILab
Params1.78B
Context32K
Q4_K_M1.1 GB
PH
lumynax reasoning phi4 mini
Phi · AbteeXAILab
Params3.84B
Context128K
Q4_K_M2.5 GB
QW
qwen2.5-3b-instruct
Qwen · AbteeXAILab
Params3.4B
Context32K
Q4_K_M2.1 GB
IN
lumynax reasoning internlm3 8b
InternLM · AbteeXAILab
Params8.8B
Context32K
Q4_K_M5.4 GB
MI
Minimax-M2
Minimax · AbteeXAILab
Params229B
Context192K
Q4_K_M138.3 GB
QW
Qwen3-30B-A3B
Qwen · AbteeXAILab
Params30.5B
Context40K
Q4_K_M18.6 GB