GGUF models by fernandoruiz
94 GGUF models quantized by fernandoruiz on Hugging Face. Sizes run from 11M to 46.7B parameters. The longest trained context is 1000K tokens.
About fernandoruiz on Hugging Face
fernandoruiz has published 94 GGUF models that ggufmodels.com tracks, across families such as Qwen, Gemma and Llama. The most downloaded are ERNIE 4.5 21B A3B PT, madlad400 3b mt Q4 K S and Gemma 3 1b It.
The quants fernandoruiz publishes most often are Q4_0 (75), Q4_K_M (10) and Q4_K_S (9). Their Q4_K_M files range from 0.7 to 16.6 GB. Parameter counts run from 11M to 46.7B, and the longest trained context window is 1000K tokens.
Frequently asked questions
What GGUF models has fernandoruiz published?
94 models are listed here, mainly from the Qwen, Gemma and Llama families. The most downloaded is ERNIE 4.5 21B A3B PT.
Which quants does fernandoruiz publish?
The most common are Q4_0 (75 models), Q4_K_M (10 models) and Q4_K_S (9 models).