GGUF models by viniciusianni

37 GGUF models quantized by viniciusianni on Hugging Face. Sizes run from 891M to 32.8B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
LFM2.5 1.2B Instruct
Lfm · viniciusianni
Params1.17B
Context125K
Smallest1.2 GB
GGUF
QW
WebWorld 8B
Qwen · viniciusianni
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
WebWorld 14B
Qwen · viniciusianni
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
GR
Granite 4.1 30b
Granite · viniciusianni
Params28.9B
Context128K
Smallest30.7 GB
GGUF
MI
Codestral 22B v0.1
Mistral · viniciusianni
Params22.2B
Context32K
Smallest23.6 GB
Coding
MI
Ministral 3 3B Instruct 2512
Mistral · viniciusianni
Params3.43B
Context256K
Smallest3.7 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · viniciusianni
Params8.03B
Context128K
Smallest8.5 GB
Tool use

Keep browsing