GGUF models by Cran-May

92 GGUF models quantized by Cran-May on Hugging Face. Sizes run from 66M to 72.7B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 22B v0.1 Q4 K S
Mistral · Cran-May
Params22.2B
Context64K
Smallest12.7 GB
GGUF
MI
SLIDE v3 Preview5 Q4 K M
Mistral · Cran-May
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing