GGUF models by ngxson
37 GGUF models quantized by ngxson on Hugging Face. Sizes run from 1M to 673B parameters. The longest trained context is 10240K tokens.
About ngxson on Hugging Face
ngxson has published 37 GGUF models that ggufmodels.com tracks, across families such as Llama, Test and Qwen. The most downloaded are tinyllama split test, test gguf models and DeepSeek R1 Distill Qwen 7B abliterated.
The quants ngxson publishes most often are Q4_K_M (14), Q8_0 (10), F16 (8) and Q2_K (3). Their Q4_K_M files range from 0.1 to 405.8 GB. Parameter counts run from 1M to 673B, and the longest trained context window is 10240K tokens.
Frequently asked questions
What GGUF models has ngxson published?
37 models are listed here, mainly from the Llama, Test and Qwen families. The most downloaded is tinyllama split test.
Which quants does ngxson publish?
The most common are Q4_K_M (14 models), Q8_0 (10 models), F16 (8 models) and Q2_K (3 models).