GGUF models by AbteeXAILab

71 GGUF models quantized by AbteeXAILab on Hugging Face. Sizes run from 135M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
lumynax coder deepseek v2 lite 16b
DeepSeek · AbteeXAILab
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
KI
lumynax multimodal kimi vl a3b thinking
Kimi · AbteeXAILab
Params16B
Context128K
Q4_K_M10.5 GB
ReasoningVision
MI
lumynax infused mistral small text
Mistral · AbteeXAILab
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool use
QW
lumynax coder qwen25 14b instruct
Qwen · AbteeXAILab
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingTool use
LL
lumynax coder codellama 70b instruct
Llama · AbteeXAILab
Params69B
Context4K
Q4_K_M41.4 GB
Coding
QW
lumynax infused qwen3 coder 30b a3b
Qwen · AbteeXAILab
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
SM
lumynax infused smollm3 3b
SmolLM · AbteeXAILab
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
DE
lumynax coder deepseek coder 33b
DeepSeek · AbteeXAILab
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
GP
Gpt Oss 20b
gpt-oss · AbteeXAILab
Params20.9B
Context128K
Smallest12.1 GB
ReasoningTool use
QW
lumynax coder codeqwen15 7b chat
Qwen · AbteeXAILab
Params7.25B
Context64K
Q4_K_M4.7 GB
Coding
QW
lumynax nz qwen25 coder 3b
Qwen · AbteeXAILab
Params3.4B
Context32K
Q4_K_M2.1 GB
CodingTool use
PH
lumynax infused phi 4 text
Phi · AbteeXAILab
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
GE
lumynax infused gemma e4b text
Gemma · AbteeXAILab
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
QW
lumynax coder qwen25 05b instruct
Qwen · AbteeXAILab
Params630M
Context32K
Q4_K_M0.5 GB
CodingTool use
GR
lumynax infused granite33 8b
Granite · AbteeXAILab
Params8.17B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
MI
Minimax-M2.5
Minimax · AbteeXAILab
Params229B
Context192K
Smallest55.8 GB
ReasoningTool use
QW
lumynax coder qwen25 15b instruct
Qwen · AbteeXAILab
Params1.78B
Context32K
Q4_K_M1.1 GB
CodingTool use
QW
Qwen2.5 VL 72B Instruct
Qwen · AbteeXAILab
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
GL
Glm-4.6V-Flash
GLM · AbteeXAILab
Params9.4B
Context128K
Smallest4.0 GB
ReasoningTool useVision
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · AbteeXAILab
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
QW
lumynax infused qwen3 14b
Qwen · AbteeXAILab
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
QW
lumynax infused qwen3 8b
Qwen · AbteeXAILab
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
ST
lumynax coder starcoder2 15b
StarCoder · AbteeXAILab
Params16B
Context16K
Q4_K_M9.9 GB
Coding
QW
lumynax coder qwen25 coder 32b
Qwen · AbteeXAILab
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
QW
lumynax coder qwen25 7b instruct
Qwen · AbteeXAILab
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingTool use
GL
Glm 4 9b Chat 1m
GLM · AbteeXAILab
Params9.48B
Context1024K
Q4_K_M6.3 GB
Tool use
SM
lumynax infused smollm 135m
SmolLM · AbteeXAILab
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
QW
lumynax infused qwen3 06b
Qwen · AbteeXAILab
Params596M
Context40K
Smallest0.6 GB
ReasoningTool use
OL
OLMoE 1B 7B 0924 Instruct
OLMo · AbteeXAILab
Params6.92B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · AbteeXAILab
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

About AbteeXAILab on Hugging Face

AbteeXAILab has published 71 GGUF models that ggufmodels.com tracks, across families such as Qwen, DeepSeek and Phi. The most downloaded are lumynax coder deepseek v2 lite 16b, lumynax multimodal kimi vl a3b thinking and lumynax infused mistral small text.

The quants AbteeXAILab publishes most often are Q4_K_M (61), F16 (4), Q8_0 (3) and TQ1_0 (1). Their Q4_K_M files range from 0.1 to 404.5 GB. Parameter counts run from 135M to 671B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has AbteeXAILab published?

71 models are listed here, mainly from the Qwen, DeepSeek and Phi families. The most downloaded is lumynax coder deepseek v2 lite 16b.

Which quants does AbteeXAILab publish?

The most common are Q4_K_M (61 models), F16 (4 models), Q8_0 (3 models) and TQ1_0 (1 models).

Keep browsing