GGUF models by NANI-Nithin
36 GGUF models quantized by NANI-Nithin on Hugging Face. Sizes run from 354M to 37.4B parameters. The longest trained context is 1024K tokens.
NA
Nanbeige4.2 3B
Nanbeige · NANI-Nithin
Params4.17B
Context256K
Q4_K_M2.6 GB
NO
north mini code
North · NANI-Nithin
Params30.5B
Context488K
Q4_K_M18.6 GB
ME
Mellum2 12B A2.5B Instruct
Mellum · NANI-Nithin
Params12.1B
Context128K
Q4_K_M8.1 GB
LF
LFM2.5 2.6B
Lfm · NANI-Nithin
Params2.7B
Context128K
Q4_K_M1.7 GB
MI
Shieldstral 1.0 3B
Mistral · NANI-Nithin
Params3.43B
Context256K
Q4_K_M2.1 GB
NE
CityQuest Nemotron 3 Nano 4B
Nemotron · NANI-Nithin
Params3.97B
Context1024K
Q4_K_M2.8 GB