Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · ijohn07
Params31.6B
Context1024K
Smallest24.5 GB
NE
FoCus Nemotron 7b
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · Lumia101
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
Nemotron 3.5 Parse
Nemotron · SkyContact
Params629M
Context16K
Smallest0.9 GB
NE
Nemotron3 8b
Nemotron · RichardErkhov
Params8.54B
Context4K
Q4_K_M5.4 GB
NE
Nemotron 3 Nano 30B A3B pirola IQ2 XXS XS
Nemotron · pirola
Params35.4B
Context1024K
Smallest0.1 GB
NE
Nemotron Labs Diffusion 8B
Nemotron · suzukimain
Params8.49B
Context256K
Q4_K_M5.2 GB
NE
Nemotron 3 Nano 30B A3B GR
Nemotron · Efso
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
NVIDIA-Nemotron-3.5-Bolt-E4B
Nemotron · WorkOffline
Params7.52B
Context128K
Smallest5.1 GB
NE
Nemotron 3 Nano Omni 30B A3B Reasoning MXFP4 MOE
Nemotron · noctrex
Params31.6B
Context1024K
Smallest18.3 GB
NE
nvidia.OpenCodeReasoning Nemotron 14B
Nemotron · DevQuasar
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
OpenReasoning Nemotron 14B
Nemotron · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
NE
Nemotron 3.5 Lightning 30B Q4 K M Imatrix
Nemotron · MESHIVEAI
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
Nemotron Research GooseReason 4B Instruct Heretic
Nemotron · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
NE
Huihui ai.AceReason Nemotron 7B Abliterated
Nemotron · DevQuasar
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Apriel Nemotron 15b Thinker
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
NE
Nemotron 3 Super 120B A12B
Nemotron · Shakeelahmad6666
Params121B
Context1024K
Q4_K_M86.1 GB
NE
Nemotron Cc Spanish Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
Nemotron Orchestrator 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
NE
Nemotron-3-Diarization.q8_0
Nemotron · empyrealworks
Params99M
Context—
Smallest0.1 GB
NE
Nemotron-3-Diarization.q8_0
Nemotron · ldov
Params99M
Context—
Smallest0.1 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · ilintar
Params8.89B
Context1024K
Smallest0.0 GB
NE
NVIDIA Nemotron 3 Super 120B A12B Base
Nemotron · coughmedicine
Params121B
Context1024K
Smallest0.3 GB
NE
OpenMath Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
Nemotron Cc Dutch Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
Nemotron Cc Icelandic Opus
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
nvidia/nemotron-3.5-asr-streaming-0.6b
Nemotron · kashif3314
Params638M
Context—
Smallest0.5 GB
NE
nvidia.NVIDIA Nemotron Nano 9B v2 Base
Nemotron · DevQuasar
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
OpenReasoning Nemotron 32B
Nemotron · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · Xylolabs
Params32.9B
Context1024K
Q4_K_M25.4 GB