GGUF models by batiai
39 GGUF models quantized by batiai on Hugging Face. Sizes run from 596M to 1570B parameters. The longest trained context is 10240K tokens.
About batiai on Hugging Face
batiai has published 39 GGUF models that ggufmodels.com tracks, across families such as Qwen, Gemma and Nemotron. The most downloaded are Qwen Qwen3.6 27B, Qwen3.8 27B and Qwen Qwen3.6 35B A3B.
The quants batiai publishes most often are Q6_K (23), Q4_K_M (20), IQ4_XS (19) and IQ3_XXS (18). Their Q4_K_M files range from 2.0 to 951.2 GB. Parameter counts run from 596M to 1570B, and the longest trained context window is 10240K tokens.
Frequently asked questions
What GGUF models has batiai published?
39 models are listed here, mainly from the Qwen, Gemma and Nemotron families. The most downloaded is Qwen Qwen3.6 27B.
Which quants does batiai publish?
The most common are Q6_K (23 models), Q4_K_M (20 models), IQ4_XS (19 models) and IQ3_XXS (18 models).