GGUF models by Novaciano
385 GGUF models quantized by Novaciano on Hugging Face. Sizes run from 33M to 10.3B parameters. The longest trained context is 128K tokens.
About Novaciano on Hugging Face
Novaciano has published 385 GGUF models that ggufmodels.com tracks, across families such as Llama, Gemma and Qwen. The most downloaded are Llama 3.2 1B NSFW Open Erotic, Llama 3.2 3b NSFW Aesir Uncensored and Llama 3.2 1b Uncensored RP Aesir.
The quants Novaciano publishes most often are Q4_K_M (112), Q5_K_M (64), Q6_K (46) and IQ4_XS (28). Their Q4_K_M files range from 0.1 to 6.3 GB. Parameter counts run from 33M to 10.3B, and the longest trained context window is 128K tokens.
Frequently asked questions
What GGUF models has Novaciano published?
385 models are listed here, mainly from the Llama, Gemma and Qwen families. The most downloaded is Llama 3.2 1B NSFW Open Erotic.
Which quants does Novaciano publish?
The most common are Q4_K_M (112 models), Q5_K_M (64 models), Q6_K (46 models) and IQ4_XS (28 models).