GGUF models by Ffftdtd5dtft
35 GGUF models quantized by Ffftdtd5dtft on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1000K tokens.
QW
Qwen2 1.5B Instruct
Qwen · Ffftdtd5dtft
Params1.54B
Context32K
Smallest0.7 GB
SA
Sarvam 2b v0.5
Sarvam · Ffftdtd5dtft
Params2.51B
Context8K
Smallest1.0 GB
CO
Codegemma 2b
Codegemma · Ffftdtd5dtft
Params2.51B
Context8K
Smallest0.8 GB
MI
Mistral Nemo Instruct 2407
Mistral · Ffftdtd5dtft
Params12.2B
Context1000K
Smallest4.8 GB
CO
Codegemma 2b
Codegemma · Ffftdtd5dtft
Params2.51B
Context8K
Smallest1.2 GB