GGUF models by fernandoruiz
94 GGUF models quantized by fernandoruiz on Hugging Face. Sizes run from 11M to 46.7B parameters. The longest trained context is 1000K tokens.
TE
t5 text summarizer Q4 0
Text · fernandoruiz
Params61M
Context512
Smallest0.0 GB
GE
Gemma 2 9b Medical
Gemma · fernandoruiz
Params9.24B
Context8K
Smallest5.5 GB
PH
Phi 3 Mini 128k Instruct
Phi · fernandoruiz
Params3.82B
Context128K
Smallest2.2 GB
MI
Mistral Small 24B Instruct 2501
Mistral · fernandoruiz
Params23.6B
Context32K
Smallest13.4 GB