Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Apriel Nemotron 15b Thinker
Nemotron · lmstudio-community
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
NE
AceReason Nemotron 1.1 7B
Nemotron · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
Nemotron · Yehor
Params30B
Context—
Smallest20.3 GB
GGUF
NE
nemotron-3.5-asr-streaming-0.6b.q8_0
Nemotron · suryatmodulus
Params648M
Context—
Smallest0.7 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4
Nemotron · FedericoFB
Params32.9B
Context1024K
Smallest22.5 GB
ReasoningTool use
NE
Nemotron3-Nano-4B-Uncensored-HauhauCS-Aggressive
Nemotron · jaromer
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
gary nemotron 8b v2
Nemotron · SMOK33Y3
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
NE
Nemotron 3 Nano 4b
Nemotron · DuoNeural
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · DrMoriarty0
Params32.9B
Context—
Smallest0.1 GB
GGUF
NE
OpenCodeReasoning Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
NVIDIA Nemotron Labs 3 Elastic 12B A2B
Nemotron · HackerTwins
Params12.4B
Context1024K
Q4_K_M9.6 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B ROCmFP4 STRIX LEAN
Nemotron · pugant
Params31.6B
Context1024K
Smallest0.1 GB
GGUF
NE
Nemotron-3.5-Super-VL-120B-A12B
Nemotron · inference-snaps
Params124B
Context1024K
Smallest77.7 GB
ReasoningTool useVision
NE
Nemotron Labs Diffusion 14B
Nemotron · suzukimain
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningTool use
NE
KnowRL Nemotron 1.5B
Nemotron · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
NE
Nemotron 3 Super 120B A12B APEX
Nemotron · Myric
Params121B
Context1024K
Smallest67.8 GB
ReasoningTool use
NE
Nemotron 3 30b
Nemotron · FreedomAISVR
Params31.6B
Context1024K
Smallest18.8 GB
ReasoningTool useVision
NE
Nemotron 3 Nano 30B A3B pirola IQ3 XXS
Nemotron · pirola
Params35.4B
Context1024K
Smallest0.1 GB
GGUF
NE
NVIDIA-NemotronLabs-RE-USE-laughter
Nemotron · sakasegawa
Params10M
Context—
Smallest0.0 GB
GGUF
NE
Nemotron 3 Nano 30B A3B MXFP4 MOE
Nemotron · noctrex
Params31.6B
Context1024K
Smallest18.0 GB
ReasoningTool use
NE
Nemotron-3-Nano-30B-A3B
Nemotron · moxin-org
Params31.6B
Context1024K
Smallest18.0 GB
CodingReasoningTool use
NE
ros nemotron 4b
Nemotron · arkdong
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
nemotron medical tuned 70b
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
NE
Nemotron 3 30b
Nemotron · FreedomAISVR
Params31.6B
Context1024K
Smallest19.3 GB
ReasoningTool useVision
NE
Nemotron Cascade 2 30B A3B
Nemotron · michaelw9999
Params31.6B
Context1024K
Smallest20.7 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · slothingaway
Params31.6B
Context1024K
Smallest33.6 GB
GGUF
NE
Apriel Nemotron 15b Thinker Magic_decensored v2_MPOA
Nemotron · Magic-Decensored
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · lipik
Params638M
Context—
Smallest0.8 GB
GGUF
NE
Nemotron 3.5 Bolt GameDev
Nemotron · ahpah
Params7.52B
Context64K
Smallest0.0 GB
GGUF
NE
OpenCodeReasoning Nemotron 14B
Nemotron · ReallyFloppyPenguin
Params14.8B
Context32K
Smallest8.5 GB
CodingReasoningTool use

Keep browsing