GGUF models by viniciusianni
37 GGUF models quantized by viniciusianni on Hugging Face. Sizes run from 891M to 32.8B parameters. The longest trained context is 1024K tokens.
LF
LFM2.5 1.2B Instruct
Lfm · viniciusianni
Params1.17B
Context125K
Smallest1.2 GB
QW
WebWorld 8B
Qwen · viniciusianni
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
WebWorld 14B
Qwen · viniciusianni
Params14.8B
Context40K
Q4_K_M9.0 GB
GR
Granite 4.1 30b
Granite · viniciusianni
Params28.9B
Context128K
Smallest30.7 GB
MI
Codestral 22B v0.1
Mistral · viniciusianni
Params22.2B
Context32K
Smallest23.6 GB
MI
Ministral 3 3B Instruct 2512
Mistral · viniciusianni
Params3.43B
Context256K
Smallest3.7 GB
LL
Llama 3.1 8B Instruct
Llama · viniciusianni
Params8.03B
Context128K
Smallest8.5 GB