Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · myflow-ai
Params638M
Context—
Smallest0.8 GB
GGUF
NE
nemotron 3.5 speaker encoder
Nemotron · kkk4oru
Params100M
Context—
Smallest0.2 GB
GGUF
NE
Nemotron-3-Diarization.q8_0
Nemotron · SAIFIINDUSTRIES
Params99M
Context—
Smallest0.1 GB
GGUF
NE
gguf Q5 K M Nemotron Mini 4B Instruct
Nemotron · mitulagr2
Params4.19B
Context4K
Smallest4.2 GB
Tool use
NE
Nemotron 3 Nano 30B A3B RotorQuant GGUF Q3 K M
Nemotron · majentik
Params31.6B
Context1024K
Smallest19.8 GB
ReasoningTool use
NE
Raj 0
Nemotron · aungzaythant
Params637M
Context—
Smallest0.7 GB
GGUF
NE
Openthai2.0 Legal Thaillm Nemotron 3 Nano 30b A3B
Nemotron · weeix
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Nemotron Speech Streaming EN
Nemotron · tryambientai
Params618M
Context—
Smallest0.7 GB
GGUF
NE
Nemotron 3.5 Lightning 30B A3B pirola IQ3 XXS
Nemotron · pirola
Params36.9B
Context1024K
Smallest0.1 GB
GGUF
NE
Nemotron Cc Finnish Tower72B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
Nemotron 15b Thinker v0.1
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
NE
Nemotron 3 Super 120B A12B TurboQuant GGUF Q4 K M
Nemotron · majentik
Params121B
Context1024K
Q4_K_M86.1 GB
GGUF
NE
Nemotron Cascade 2 30B A3B
Nemotron · AesSedai
Params31.6B
Context1024K
Q4_K_M23.5 GB
ReasoningTool use
NE
Nvidia Nemotron 3.5 Content Safety
Nemotron · aashish1904
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · alexcovo
Params12.3B
Context1024K
Q4_K_M7.5 GB
ReasoningTool use
NE
Nemotron Orchestrator 8B Claude 4.5 Opus Distill
Nemotron · mohusein
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
Nemotron 3 Super 120B A12B MTP
Nemotron · Premshay
Params124B
Context1024K
Smallest71.3 GB
ReasoningTool use
NE
Nemotron Cc Polish Opus
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
ghira asr vi 0.6b
Nemotron · nhtera
Params648M
Context—
Smallest0.7 GB
GGUF
NE
nvidia Nemotron Mini 4B Instruct
Nemotron · tensorblock
Params4.19B
Context4K
Smallest1.9 GB
Tool use
NE
NVIDIA Nemotron 3 Nano 30B A3B NVFP4
Nemotron · FedericoFB
Params31.6B
Context1024K
Smallest19.3 GB
ReasoningTool use
NE
Elbaz NVIDIA Nemotron 3 Nano 30B A3B PRISM
Nemotron · nuottroisaoduoc
Params31.6B
Context1024K
Smallest18.2 GB
CodingReasoningTool use
NE
ServiceNow AI Apriel Nemotron 15b Thinker
Nemotron · tensorblock
Params15B
Context64K
Smallest5.8 GB
ReasoningTool use
NE
Nemotron Mini 4B Instruct Q8 0
Nemotron · NikolayKozloff
Params4.19B
Context4K
Smallest4.5 GB
Tool use
NE
Nvidia NVIDIA Nemotron 3 Super 120B A12B BF16
Nemotron · batiai
Params121B
Context1024K
Smallest56.8 GB
ReasoningTool use
NE
Nemotron Cascade 2 30B A3B TurboQuant GGUF Q4 K M
Nemotron · majentik
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
OpenReasoning Nemotron 1.5B
Nemotron · tensorblock
Params1.54B
Context128K
Smallest0.7 GB
CodingReasoning
NE
Nemotron-3-Diarization
Nemotron · sakasegawa
Params99M
Context—
Smallest0.1 GB
GGUF
NE
Nemotron 3 Nano 30B A3B RotorQuant GGUF Q8 0
Nemotron · majentik
Params31.6B
Context1024K
Smallest33.6 GB
ReasoningTool use
NE
Nemotron Cc Norwegian Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF

Keep browsing