GGUF models by AbteeXAILab

71 GGUF models quantized by AbteeXAILab on Hugging Face. Sizes run from 135M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
lumynax reasoning deepseek r1 qwen 15b
DeepSeek · AbteeXAILab
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
lumynax reasoning deepseek distill text
DeepSeek · AbteeXAILab
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
QW
lumynax frontier qwen3 235b a22b instruct
Qwen · AbteeXAILab
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningTool use
QW
lumynax reasoning qwq 32b
Qwen · AbteeXAILab
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
QW
lumynax infused qwen3 text
Qwen · AbteeXAILab
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen2.5 72B Instruct
Qwen · AbteeXAILab
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
YI
lumynax chat yi 15 34b
Yi · AbteeXAILab
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
GE
lumynax infused gemma4 26b a4b
Gemma · AbteeXAILab
Params25.2B
Context256K
Q4_K_M16.9 GB
ReasoningTool useVision
MO
lumynax moe moonlight 16b a3b
Moonlight · AbteeXAILab
Params16B
Context8K
Smallest8.7 GB
GGUF
GR
lumynax infused granite31 1b a400m
Granite · AbteeXAILab
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
GR
lumynax infused granite33 2b
Granite · AbteeXAILab
Params2.53B
Context128K
Q4_K_M1.5 GB
ReasoningTool use
DB
lumynax frontier dbrx instruct 132b
Dbrx · AbteeXAILab
Params132B
Context32K
Smallest47.9 GB
GGUF
MI
lumynax infused mistral 7b v03
Mistral · AbteeXAILab
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
QW
qwen2.5-7b-instruct
Qwen · AbteeXAILab
Params7.62B
Context128K
Smallest3.8 GB
Tool use
SM
lumynax infused smollm2 17b
SmolLM · AbteeXAILab
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
MI
lumynax frontier mixtral 8x22b instruct
Mistral · AbteeXAILab
Params141B
Context64K
Q4_K_M85.6 GB
Tool use
PH
Phi 4 Mini Instruct
Phi · AbteeXAILab
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
lumynax frontier phi 4 14b
Phi · AbteeXAILab
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
CO
lumynax coder yi coder 9b
Coder · AbteeXAILab
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
PH
lumynax infused phi3 mini 4k
Phi · AbteeXAILab
Params3.82B
Context4K
Smallest2.4 GB
GGUF
OL
lumynax infused olmo2 7b 1124
OLMo · AbteeXAILab
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
QW
lumynax frontier coder qwen3 480b a35b
Qwen · AbteeXAILab
Params480B
Context256K
Q4_K_M290.1 GB
CodingTool use
DE
lumynax reasoning deepseek r1 qwen 7b
DeepSeek · AbteeXAILab
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek V2.5 1210
DeepSeek · AbteeXAILab
Params236B
Context160K
Q4_K_M142.5 GB
CodingTool use
QW
qwen2.5-1.5b-instruct
Qwen · AbteeXAILab
Params1.78B
Context32K
Q4_K_M1.1 GB
Tool use
PH
lumynax reasoning phi4 mini
Phi · AbteeXAILab
Params3.84B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
QW
qwen2.5-3b-instruct
Qwen · AbteeXAILab
Params3.4B
Context32K
Q4_K_M2.1 GB
Tool use
IN
lumynax reasoning internlm3 8b
InternLM · AbteeXAILab
Params8.8B
Context32K
Q4_K_M5.4 GB
Reasoning
MI
Minimax-M2
Minimax · AbteeXAILab
Params229B
Context192K
Q4_K_M138.3 GB
ReasoningTool use
QW
Qwen3-30B-A3B
Qwen · AbteeXAILab
Params30.5B
Context40K
Q4_K_M18.6 GB
ReasoningTool use

Keep browsing