GGUF models by WhiskyAKM
35 GGUF models quantized by WhiskyAKM on Hugging Face. Sizes run from 1.01B to 177B parameters. The longest trained context is 1024K tokens.
About WhiskyAKM on Hugging Face
WhiskyAKM has published 35 GGUF models that ggufmodels.com tracks, across families such as Gemma, Qwen and MiniCPM. The most downloaded are LFM2.5 24B A2B, Gemma 4 E2B it qat NVFP4 and Gemma 4 26B A4B it qat NVFP4.
The quants WhiskyAKM publishes most often are BF16 (15), Q8_0 (12), Q6_K (12) and Q5_K_S (12). Their Q4_K_M files range from 0.2 to 77.0 GB. Parameter counts run from 1.01B to 177B, and the longest trained context window is 1024K tokens.
Frequently asked questions
What GGUF models has WhiskyAKM published?
35 models are listed here, mainly from the Gemma, Qwen and MiniCPM families. The most downloaded is LFM2.5 24B A2B.
Which quants does WhiskyAKM publish?
The most common are BF16 (15 models), Q8_0 (12 models), Q6_K (12 models) and Q5_K_S (12 models).