GGUF models by Lucy-in-the-Sky
265 GGUF models quantized by Lucy-in-the-Sky on Hugging Face. Sizes run from 494M to 46.7B parameters. The longest trained context is 1000K tokens.
About Lucy-in-the-Sky on Hugging Face
Lucy-in-the-Sky has published 265 GGUF models that ggufmodels.com tracks, across families such as Qwen, DeepSeek and Mistral. The most downloaded are Dolphin Mistral 24B Venice Edition, Qwen2.5 14B Instruct Abliterated v2 and Qwen3 4B Abliterated.
The quants Lucy-in-the-Sky publishes most often are Q8_0 (82), Q4_K_M (71), Q6_K (54) and Q2_K (46). Their Q4_K_M files range from 0.9 to 28.4 GB. Parameter counts run from 494M to 46.7B, and the longest trained context window is 1000K tokens.
Frequently asked questions
What GGUF models has Lucy-in-the-Sky published?
265 models are listed here, mainly from the Qwen, DeepSeek and Mistral families. The most downloaded is Dolphin Mistral 24B Venice Edition.
Which quants does Lucy-in-the-Sky publish?
The most common are Q8_0 (82 models), Q4_K_M (71 models), Q6_K (54 models) and Q2_K (46 models).