GGUF models by SzilviaB
87 GGUF models quantized by SzilviaB on Hugging Face. Sizes run from 5.94B to 38.7B parameters. The longest trained context is 1000K tokens.
About SzilviaB on Hugging Face
SzilviaB has published 87 GGUF models that ggufmodels.com tracks, across families such as Mergekit, Gemma and Magnum. The most downloaded are Magnum Yi 34b Q4 K M, Yi Magnum Smaug 34b Q4 K M and gemma 2 9b it multilingual Q8 0.
The quants SzilviaB publishes most often are Q8_0 (51), Q5_K_M (23), Q4_K_M (8) and Q6_K (2). Their Q4_K_M files range from 4.9 to 41.3 GB. Parameter counts run from 5.94B to 38.7B, and the longest trained context window is 1000K tokens.
Frequently asked questions
What GGUF models has SzilviaB published?
87 models are listed here, mainly from the Mergekit, Gemma and Magnum families. The most downloaded is Magnum Yi 34b Q4 K M.
Which quants does SzilviaB publish?
The most common are Q8_0 (51 models), Q5_K_M (23 models), Q4_K_M (8 models) and Q6_K (2 models).