GGUF models by NANI-Nithin

36 GGUF models quantized by NANI-Nithin on Hugging Face. Sizes run from 354M to 37.4B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
K2 Horizon MoVA 36B A4B
Horizon · NANI-Nithin
Params37.4B
Context512K
Q4_K_M22.4 GB
Reasoning
LF
LFM2.5-24B-A2B
Lfm · NANI-Nithin
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
MU
Muse Glimmer 30B
Muse · NANI-Nithin
Params28B
Context128K
Q4_K_M16.9 GB
Tool useVision
LI
Ling 3.0 tiny
Ling · NANI-Nithin
Params7.89B
Context128K
Q4_K_M4.8 GB
Reasoning
D1
d1 3B
NANI-Nithin
Params2.7B
Context32K
Q4_K_M1.7 GB
GGUF
MI
MiniCPM5 1B
MiniCPM · NANI-Nithin
Params1.08B
Context128K
Q4_K_M0.7 GB
GGUF
RA
Raon 1 mini preview
Raon · NANI-Nithin
Params28.8B
Context256K
Q4_K_M19.7 GB
ReasoningTool use
MA
manaca 1b base
Manaca · NANI-Nithin
Params1.72B
Context4K
Q4_K_M1.1 GB
GGUF
FR
FrogNano 4B 2609
Frognano · NANI-Nithin
Params4.33B
Context256K
Q4_K_M2.8 GB
CodingVision
LI
LightOnOCR 3 0.8B
Lightonocr · NANI-Nithin
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
HO
K2 Horizon 3.7B
Horizon · NANI-Nithin
Params5.06B
Context512K
Q4_K_M3.2 GB
GGUF
CL
clef flash
Clef · NANI-Nithin
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
MI
MiniCPM V 4.7 1B
MiniCPM · NANI-Nithin
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
HO
K2 Horizon 7B
Horizon · NANI-Nithin
Params9B
Context512K
Q4_K_M5.6 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · NANI-Nithin
Params32.9B
Context1024K
Q4_K_M25.4 GB
GGUF
LF
LFM2.5 350M RLCD
Lfm · NANI-Nithin
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
HO
K2 Horizon 0.9B
Horizon · NANI-Nithin
Params1.08B
Context128K
Q4_K_M0.7 GB
GGUF
OR
Ornith 1.5 35B A3B
Ornith · NANI-Nithin
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
IN
Instella MoE 16B A3B Think
Instella · NANI-Nithin
Params15.9B
Context32K
Q4_K_M10.5 GB
Reasoning
GR
granite 4.2 3b
Granite · NANI-Nithin
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
G9
G9v3 3B
NANI-Nithin
Params3B
Context128K
Q4_K_M1.8 GB
GGUF
OR
Ornith 1.5 9B
Ornith · NANI-Nithin
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
MI
MiniCPM5 2B
MiniCPM · NANI-Nithin
Params2.52B
Context128K
Q4_K_M1.6 GB
Tool use
QW
Qwen3 0.6B
Qwen · NANI-Nithin
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
TW
TwIL LM3
Twil · NANI-Nithin
Params3.08B
Context64K
Q4_K_M1.9 GB
Reasoning
QW
Qwen3 TTS 12Hz 1.7B Base
Qwen · NANI-Nithin
Params1.73B
Context32K
Q4_K_M1.0 GB
Vision
SE
SenseNova U1.5 8B MoT
Sensenova · NANI-Nithin
Params17.5B
Context—
Smallest10.9 GB
GGUF
GR
granite 4.2 8b
Granite · NANI-Nithin
Params8.8B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
LF
LFM2.5 VL 3B
Lfm · NANI-Nithin
Params2.7B
Context125K
Q4_K_M1.7 GB
ReasoningTool useVision
VO
VoxCPM2
Voxcpm · NANI-Nithin
Params—
Context—
Smallest1.6 GB
GGUF

About NANI-Nithin on Hugging Face

NANI-Nithin has published 36 GGUF models that ggufmodels.com tracks, across families such as Lfm, Horizon and MiniCPM. The most downloaded are K2 Horizon MoVA 36B A4B, LFM2.5-24B-A2B and Muse Glimmer 30B.

The quants NANI-Nithin publishes most often are Q8_0 (34), Q6_K (34), Q4_K_M (34) and Q5_K_M (33). Their Q4_K_M files range from 0.2 to 25.4 GB. Parameter counts run from 354M to 37.4B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has NANI-Nithin published?

36 models are listed here, mainly from the Lfm, Horizon and MiniCPM families. The most downloaded is K2 Horizon MoVA 36B A4B.

Which quants does NANI-Nithin publish?

The most common are Q8_0 (34 models), Q6_K (34 models), Q4_K_M (34 models) and Q5_K_M (33 models).

Keep browsing