GGUF models by Cran-May
92 GGUF models quantized by Cran-May on Hugging Face. Sizes run from 66M to 72.7B parameters. The longest trained context is 1000K tokens.
MI
Mistral 22B v0.1 Q4 K S
Mistral · Cran-May
Params22.2B
Context64K
Smallest12.7 GB
MI
SLIDE v3 Preview5 Q4 K M
Mistral · Cran-May
Params7.24B
Context32K
Q4_K_M4.4 GB