Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · lmstudio-community
Params7.52B
Context128K
Q4_K_M6.2 GB
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B Abliterated
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
Acereason-Nemotron-14B
Nemotron · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
Nemotron 3.5 Content Safety
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
NE
ThinkingCap NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · bottlecapai
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B BF16
Nemotron · Jmica
Params38B
Context1024K
Smallest13.9 GB
NE
OpenReasoning Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
NE
NVIDIA Nemotron 3 Super 120B A12B BF16 heretic v2
Nemotron · Sabomako
Params121B
Context1024K
Smallest68.6 GB
NE
Ternary Nemotron 3.5 Lightning 30B A3B
Nemotron · boro64
Params31.6B
Context1024K
Smallest9.5 GB
NE
ThinkingCap NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
AceReason Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4 LiLiCorr
Nemotron · magnitudedev
Params1.66B
Context1024K
Smallest1.4 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B 24GB LiLiCorr
Nemotron · magnitudedev
Params1.11B
Context256K
Smallest1.0 GB
NE
Nemotron SEA LION v4.8 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
Nemotron Terminal 14B Heretic
Nemotron · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · QuantFactory
Params12B
Context—
Q4_K_M6.3 GB
NE
Nemotron 3.5 Lightning 30B A3B Olympics Reasoning
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
Fastino Nemotron 3.5 Lightning Finance
Nemotron · nicolasembleton
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
ServiceNow AI Apriel Nemotron 15b Thinker Chatml
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
NE
OpenMath Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
NE
Nemotron 3 8b Chat 4k Sft Hf
Nemotron · mradermacher
Params8.54B
Context4K
Q4_K_M5.4 GB
NE
OpenReasoning Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
Nemotron Cascade 14B Thinking
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
Openreasoning-Nemotron-32B
Nemotron · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB
NE
OpenMath Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Nemotron 3.5 Lightning 30B A3B Cricket Reasoning
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
NVIDIA Nemotron Labs 3 Elastic 12B A2B
Nemotron · mradermacher
Params12.4B
Context1024K
Q4_K_M9.6 GB
NE
Nemotron Terminal 32B
Nemotron · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
NE
OpenMath Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB