Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · mmnga-o
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
Nemotron 3.5 Super 120B A12B NVFP4 Strata Blackwell
Nemotron · Cudecnik
Params124B
Context1024K
Smallest71.6 GB
NE
Nemotron 3.5 Bolt 74B A9B 24GB Metal
Nemotron · UraionLabs
Params74B
Context256K
Smallest24.2 GB
NE
Orchestrator 8B
Nemotron · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
NE
Nemotron 3 Embed 8B BF16
Nemotron · Aqua00
Params7.95B
Context256K
Q4_K_M4.9 GB
NE
Nemotron H 8B Reasoning 128K
Nemotron · bartowski
Params8.1B
Context1024K
Q4_K_M5.0 GB
NE
AceReason Nemotron 1.1 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Nemotron Cascade 8B
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
NE
Nemotron 3.5 Lightning 30B A3B Uncensored xCloud
Nemotron · xCloudinfo
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B abliterated
Nemotron · IstroSec
Params32.9B
Context1024K
Smallest0.1 GB
NE
nvidia OpenCodeReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
Sakura Nemotron 3.5 Bolt 74B A9B 24GB Uncensored
Nemotron · webmp3
Params74B
Context256K
Smallest23.4 GB
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
Nemotron · sakasegawa
Params33.7B
Context—
Smallest19.0 GB
NE
nemotron 3.5 asr streaming
Nemotron · cstr
Params638M
Context—
Smallest0.4 GB
NE
NVIDIA-Nemotron-3.5-Bolt-74B-DERISKED
Nemotron · freakyskittle
Params74B
Context1024K
Q4_K_M46.4 GB
NE
OpenReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
Heretic Nemotron Content Safety Reasoning 4B
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
NE
NVIDIA NemotronLabs VoiceChat 11B
Nemotron · hoidhxd
Params11.1B
Context—
Smallest0.3 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4 DFlash
Nemotron · magnitudedev
Params833M
Context1024K
Smallest1.2 GB
NE
Nemotron-3-Nano-30B-A3B
Nemotron · mudler
Params31.6B
Context1024K
Smallest18.8 GB
NE
Nemotron Cascade 14B Thinking
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
Nemotron Cascade 2 30B A3B
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
OpenReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
ThinkingCap NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
Nemotron 3 Super 120B A12B Uncensored
Nemotron · timteh673
Params121B
Context1024K
Q4_K_M86.1 GB
NE
nvidia OpenCodeReasoning Nemotron 32B IOI
Nemotron · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
NE
addis scribe streaming
Nemotron · addisai
Params99M
Context—
Smallest0.0 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B
Nemotron · natalie5
Params1.63B
Context1024K
Smallest1.3 GB
NE
OpenMath Nemotron 14B Kaggle
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · vcruz305
Params31.6B
Context1024K
Smallest9.8 GB