Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
Nemotron 3 Nano 30B A3B RotorQuant GGUF IQ4 XS
Nemotron · majentik
Params31.6B
Context1024K
Smallest18.2 GB
NE
Nemotron 3 Super 120B A12B TurboQuant GGUF Q2 K
Nemotron · majentik
Params121B
Context1024K
Smallest53.5 GB
NE
Nemotron Mini 4B Instruct Q4 K M
Nemotron · itlwas
Params4.19B
Context4K
Q4_K_M2.7 GB
NE
NVIDIA Nemotron 3 Nano 30B A3B NVFP4
Nemotron · IwakuraRein
Params31.6B
Context1024K
Smallest19.3 GB
NE
Nemotron 4B
Nemotron · Amritemperor123
Params3.97B
Context1024K
Smallest4.2 GB
NE
Nemotron Content Safety Reasoning 4B
Nemotron · klnstpr
Params4.55B
Context128K
Q4_K_M2.9 GB
NE
Nemotron-3-Nano-30B-A3B
Nemotron · Iambackup
Params31.6B
Context1024K
Smallest33.5 GB
NE
Nemotron 3 Nano 30B A3B TurboQuant GGUF Q4 K M
Nemotron · majentik
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
Nemotron-3-Nano-30B-A3B
Nemotron · gsrunion
Params31.6B
Context1024K
Smallest16.9 GB
NE
Finnemotron R1 Sft
Nemotron · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
Nemotron-3-Nano-30B-A3B
Nemotron · altomek
Params31.6B
Context1024K
Smallest28.6 GB
NE
OpenMath Nemotron 1.5B
Nemotron · devisri050
Params1.54B
Context128K
Smallest0.9 GB
NE
NVIDIA-Nemotron-Nano-9B-v2
Nemotron · impacte
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
OpenReasoning Nemotron 7B
Nemotron · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
NE
Nemotron Picaro fp16
Nemotron · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · ijohn07
Params31.6B
Context1024K
Smallest19.8 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · aclava
Params31.6B
Context1024K
Smallest19.8 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · voconly-org
Params638M
Context—
Q4_K_M0.5 GB
NE
OpenMath-Nemotron-1.5B-PruneAware-grpo
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
Nemotron 3 Nano 4B RotorQuant GGUF Q3 K M
Nemotron · majentik
Params3.97B
Context1024K
Smallest2.4 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · thecodehaider
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
Nemotron Cc Basque Opus
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
nemotron 3.5 singlish multilingual
Nemotron · provsalt
Params648M
Context—
Smallest0.7 GB
NE
Nemotron 3 Nano Omni 30B A3B Reasoning TurboQuant GGUF Q3 K M
Nemotron · majentik
Params31.6B
Context1024K
Smallest19.8 GB
NE
NVIDIA Nemotron 3.5 Lightning
Nemotron · impacte
Params32.9B
Context1024K
Smallest18.7 GB
NE
Thhaus Nemotron3 8b
Nemotron · tensorblock
Params8.54B
Context4K
Smallest3.7 GB
NE
nvidia nemotron nano 12b v2 q4 k m
Nemotron · Avarok
Params12.3B
Context1024K
Smallest7.5 GB
NE
Nemotron Cascade 2 30B A3B TurboQuant GGUF Q3 K M
Nemotron · majentik
Params31.6B
Context1024K
Smallest19.8 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · Triago
Params12.3B
Context1024K
Smallest13.1 GB
NE
Nemotron Cascade 14B Thinking
Nemotron · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB