GGUF models by ND911
46 GGUF models quantized by ND911 on Hugging Face. Sizes run from 2.47B to 20B parameters. The longest trained context is 1000K tokens.
About ND911 on Hugging Face
ND911 has published 46 GGUF models that ggufmodels.com tracks, across families such as Flux, Mistral and Stable. The most downloaded are Test Frankenstein, Flux 3 Image Klein Pup and EclecticEuphoria Flux Unet Models.
The quants ND911 publishes most often are Q8_0 (35), Q6_K (23), Q4_K (16) and Q5_K (14). Their Q4_K_M files range from 4.4 to 12.0 GB. Parameter counts run from 2.47B to 20B, and the longest trained context window is 1000K tokens.
Frequently asked questions
What GGUF models has ND911 published?
46 models are listed here, mainly from the Flux, Mistral and Stable families. The most downloaded is Test Frankenstein.
Which quants does ND911 publish?
The most common are Q8_0 (35 models), Q6_K (23 models), Q4_K (16 models) and Q5_K (14 models).