Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron Super 49B Roleplay SFT
Nemotron · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
Roleplay
NE
nvidia_Nemotron 3 Nano Omni 30B A3B Reasoning NVFP4
Nemotron · eepos
Params31.6B
Context1024K
Smallest21.0 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B MagicQuant
Nemotron · lmcoleman
Params32.9B
Context1024K
Q4_K_M18.9 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · Lauarvik
Params8.89B
Context1024K
Q4_K_M6.5 GB
CodingReasoningTool use
NE
.nemotron-speech-streaming-en-0.6b.q8_0.gguf
Nemotron · onemira
Params628M
Context—
Smallest0.7 GB
GGUF
NE
OpenCodeReasoning Nemotron 32B i1
Nemotron · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
Nemotron 15b Thinker Instruct
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
NE
nvidia.Nemotron Mini 4B Instruct
Nemotron · DevQuasar-7
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
NVIDIA-Nemotron-3.5-Bolt-74B-A9B
Nemotron · vultr
Params74B
Context1024K
Q4_K_M51.0 GB
ReasoningTool useVision
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4 DSpark
Nemotron · magnitudedev
Params968M
Context1024K
Smallest1.4 GB
ReasoningTool use
NE
OpenCodeReasoning Nemotron 32B IOI i1
Nemotron · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
Nvidia-Nemotron-3-Nano-Omni-30B-A3B-Reasoning
Nemotron · Hagwell
Params31.6B
Context1024K
Q4_K_M23.9 GB
ReasoningTool useVision
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4 noMTP
Nemotron · waseigo
Params31.6B
Context1024K
Smallest19.8 GB
ReasoningTool use
NE
Nemotron Cascade 2 30B A3B
Nemotron · freddm
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
OpenMath Nemotron 1.5B
Nemotron · DevQuasar-13
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
NE
AceReason Nemotron 14B
Nemotron · QuantFactory
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
NE
Nemotron-Labs-Audex-30B-A3B-textonly
Nemotron · LordNeel
Params32B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Apriel Nemotron 15b Thinker Magic_decensored v2_MPOA
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
NE
OpenMath-Nemotron-1.5B-PruneAware-2
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
NE
Nemotron Nano 30b A3B Clinical Instruct
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Nemotron Cascade 14B Thinking Impotent Heresy
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
NE
Nemotron 3 Puzzle 75B A9B
Nemotron · YanissAmz
Params78.3B
Context1024K
Q4_K_M51.6 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · terelabs
Params7.52B
Context64K
Smallest0.0 GB
GGUF
NE
NVIDIA Nemotron 3.5 Transcribe 30B A4B ROCmFPX
Nemotron · Harsha001
Params784M
Context—
Smallest1.7 GB
GGUF
NE
Nemotron 70b Math v1
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
NE
Nemotron-Mini-4B-Instruct
Nemotron · Mungert
Params4.19B
Context4K
Q4_K_M2.9 GB
Tool use
NE
OpenReasoning Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoning
NE
OpenCodeReasoning Nemotron 1.1 32B
Nemotron · mradermacher
Params32.8B
Context64K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
Nemotron3 Nano Uncensored Aggressive
Nemotron · tripolskypetr
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
nemotron 3 nano 4b ascii art
Nemotron · sayshara
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use

Keep browsing