GGUF models by Elfrino
46 GGUF models quantized by Elfrino on Hugging Face. Sizes run from 7.24B to 33.3B parameters. The longest trained context is 32K tokens.
About Elfrino on Hugging Face
Elfrino has published 46 GGUF models that ggufmodels.com tracks, across families such as Psymedlewd, Xwinxtended and Psymerhyst. The most downloaded are XwinXtended 20B Q4 K M, PsychoPomp 20B Q5 K M and PsyMedLewd Q4 K M.
The quants Elfrino publishes most often are Q5_K_M (37), Q4_K_M (5) and Q8_0 (4). Their Q4_K_M files range from 12.0 to 12.0 GB. Parameter counts run from 7.24B to 33.3B, and the longest trained context window is 32K tokens.
Frequently asked questions
What GGUF models has Elfrino published?
46 models are listed here, mainly from the Psymedlewd, Xwinxtended and Psymerhyst families. The most downloaded is XwinXtended 20B Q4 K M.
Which quants does Elfrino publish?
The most common are Q5_K_M (37 models), Q4_K_M (5 models) and Q8_0 (4 models).