GGUF models by fernandoruiz

94 GGUF models quantized by fernandoruiz on Hugging Face. Sizes run from 11M to 46.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
TE
t5 text summarizer Q4 0
Text · fernandoruiz
Params61M
Context512
Smallest0.0 GB
GGUF
GE
Gemma 2 9b Medical
Gemma · fernandoruiz
Params9.24B
Context8K
Smallest5.5 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · fernandoruiz
Params3.82B
Context128K
Smallest2.2 GB
Coding
MI
Mistral Small 24B Instruct 2501
Mistral · fernandoruiz
Params23.6B
Context32K
Smallest13.4 GB
GGUF

Keep browsing