Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · ijohn07
Params31.6B
Context1024K
Smallest24.5 GB
GGUF
NE
FoCus Nemotron 7b
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · Lumia101
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
Nemotron 3.5 Parse
Nemotron · SkyContact
Params629M
Context16K
Smallest0.9 GB
Vision
NE
Nemotron3 8b
Nemotron · RichardErkhov
Params8.54B
Context4K
Q4_K_M5.4 GB
GGUF
NE
Nemotron 3 Nano 30B A3B pirola IQ2 XXS XS
Nemotron · pirola
Params35.4B
Context1024K
Smallest0.1 GB
GGUF
NE
Nemotron Labs Diffusion 8B
Nemotron · suzukimain
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool use
NE
Nemotron 3 Nano 30B A3B GR
Nemotron · Efso
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
NVIDIA-Nemotron-3.5-Bolt-E4B
Nemotron · WorkOffline
Params7.52B
Context128K
Smallest5.1 GB
ReasoningTool use
NE
Nemotron 3 Nano Omni 30B A3B Reasoning MXFP4 MOE
Nemotron · noctrex
Params31.6B
Context1024K
Smallest18.3 GB
ReasoningTool useVision
NE
nvidia.OpenCodeReasoning Nemotron 14B
Nemotron · DevQuasar
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
OpenReasoning Nemotron 14B
Nemotron · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
CodingReasoning
NE
Nemotron 3.5 Lightning 30B Q4 K M Imatrix
Nemotron · MESHIVEAI
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
Nemotron Research GooseReason 4B Instruct Heretic
Nemotron · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
NE
Huihui ai.AceReason Nemotron 7B Abliterated
Nemotron · DevQuasar
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NE
Apriel Nemotron 15b Thinker
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
NE
Nemotron 3 Super 120B A12B
Nemotron · Shakeelahmad6666
Params121B
Context1024K
Q4_K_M86.1 GB
ReasoningTool use
NE
Nemotron Cc Spanish Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
Nemotron Orchestrator 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
Nemotron-3-Diarization.q8_0
Nemotron · empyrealworks
Params99M
Context—
Smallest0.1 GB
GGUF
NE
Nemotron-3-Diarization.q8_0
Nemotron · ldov
Params99M
Context—
Smallest0.1 GB
GGUF
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · ilintar
Params8.89B
Context1024K
Smallest0.0 GB
GGUF
NE
NVIDIA Nemotron 3 Super 120B A12B Base
Nemotron · coughmedicine
Params121B
Context1024K
Smallest0.3 GB
GGUF
NE
OpenMath Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
NE
Nemotron Cc Dutch Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
Nemotron Cc Icelandic Opus
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
nvidia/nemotron-3.5-asr-streaming-0.6b
Nemotron · kashif3314
Params638M
Context—
Smallest0.5 GB
GGUF
NE
nvidia.NVIDIA Nemotron Nano 9B v2 Base
Nemotron · DevQuasar
Params8.89B
Context1024K
Q4_K_M6.5 GB
GGUF
NE
OpenReasoning Nemotron 32B
Nemotron · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
CodingReasoning
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · Xylolabs
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use

Keep browsing