Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron 3 Nano 30B A3B RotorQuant GGUF IQ4 XS
Nemotron · majentik
Params31.6B
Context1024K
Smallest18.2 GB
ReasoningTool use
NE
Nemotron 3 Super 120B A12B TurboQuant GGUF Q2 K
Nemotron · majentik
Params121B
Context1024K
Smallest53.5 GB
GGUF
NE
Nemotron Mini 4B Instruct Q4 K M
Nemotron · itlwas
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
NVIDIA Nemotron 3 Nano 30B A3B NVFP4
Nemotron · IwakuraRein
Params31.6B
Context1024K
Smallest19.3 GB
ReasoningTool use
NE
Nemotron 4B
Nemotron · Amritemperor123
Params3.97B
Context1024K
Smallest4.2 GB
CodingReasoningTool use
NE
Nemotron Content Safety Reasoning 4B
Nemotron · klnstpr
Params4.55B
Context128K
Q4_K_M2.9 GB
Reasoning
NE
Nemotron-3-Nano-30B-A3B
Nemotron · Iambackup
Params31.6B
Context1024K
Smallest33.5 GB
CodingReasoningTool use
NE
Nemotron 3 Nano 30B A3B TurboQuant GGUF Q4 K M
Nemotron · majentik
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Nemotron-3-Nano-30B-A3B
Nemotron · gsrunion
Params31.6B
Context1024K
Smallest16.9 GB
ReasoningTool use
NE
Finnemotron R1 Sft
Nemotron · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
NE
Nemotron-3-Nano-30B-A3B
Nemotron · altomek
Params31.6B
Context1024K
Smallest28.6 GB
CodingReasoningTool use
NE
OpenMath Nemotron 1.5B
Nemotron · devisri050
Params1.54B
Context128K
Smallest0.9 GB
Reasoning
NE
NVIDIA-Nemotron-Nano-9B-v2
Nemotron · impacte
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
OpenReasoning Nemotron 7B
Nemotron · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
CodingReasoning
NE
Nemotron Picaro fp16
Nemotron · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · ijohn07
Params31.6B
Context1024K
Smallest19.8 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · aclava
Params31.6B
Context1024K
Smallest19.8 GB
GGUF
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · voconly-org
Params638M
Context—
Q4_K_M0.5 GB
GGUF
NE
OpenMath-Nemotron-1.5B-PruneAware-grpo
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
NE
Nemotron 3 Nano 4B RotorQuant GGUF Q3 K M
Nemotron · majentik
Params3.97B
Context1024K
Smallest2.4 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · thecodehaider
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Nemotron Cc Basque Opus
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
nemotron 3.5 singlish multilingual
Nemotron · provsalt
Params648M
Context—
Smallest0.7 GB
GGUF
NE
Nemotron 3 Nano Omni 30B A3B Reasoning TurboQuant GGUF Q3 K M
Nemotron · majentik
Params31.6B
Context1024K
Smallest19.8 GB
ReasoningTool useVision
NE
NVIDIA Nemotron 3.5 Lightning
Nemotron · impacte
Params32.9B
Context1024K
Smallest18.7 GB
ReasoningTool use
NE
Thhaus Nemotron3 8b
Nemotron · tensorblock
Params8.54B
Context4K
Smallest3.7 GB
GGUF
NE
nvidia nemotron nano 12b v2 q4 k m
Nemotron · Avarok
Params12.3B
Context1024K
Smallest7.5 GB
ReasoningTool use
NE
Nemotron Cascade 2 30B A3B TurboQuant GGUF Q3 K M
Nemotron · majentik
Params31.6B
Context1024K
Smallest19.8 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · Triago
Params12.3B
Context1024K
Smallest13.1 GB
ReasoningTool use
NE
Nemotron Cascade 14B Thinking
Nemotron · NikolayKozloff
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use

Keep browsing