Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · lmstudio-community
Params7.52B
Context128K
Q4_K_M6.2 GB
ReasoningTool use
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B Abliterated
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
Acereason-Nemotron-14B
Nemotron · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
Nemotron 3.5 Content Safety
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
NE
ThinkingCap NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · bottlecapai
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B BF16
Nemotron · Jmica
Params38B
Context1024K
Smallest13.9 GB
Vision
NE
OpenReasoning Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
NE
NVIDIA Nemotron 3 Super 120B A12B BF16 heretic v2
Nemotron · Sabomako
Params121B
Context1024K
Smallest68.6 GB
ReasoningTool use
NE
Ternary Nemotron 3.5 Lightning 30B A3B
Nemotron · boro64
Params31.6B
Context1024K
Smallest9.5 GB
ReasoningTool use
NE
ThinkingCap NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
AceReason Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4 LiLiCorr
Nemotron · magnitudedev
Params1.66B
Context1024K
Smallest1.4 GB
ReasoningTool useVision
NE
OpenReasoning Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B 24GB LiLiCorr
Nemotron · magnitudedev
Params1.11B
Context256K
Smallest1.0 GB
ReasoningTool use
NE
Nemotron SEA LION v4.8 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
Nemotron Terminal 14B Heretic
Nemotron · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · QuantFactory
Params12B
Context—
Q4_K_M6.3 GB
GGUF
NE
Nemotron 3.5 Lightning 30B A3B Olympics Reasoning
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
Fastino Nemotron 3.5 Lightning Finance
Nemotron · nicolasembleton
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
ServiceNow AI Apriel Nemotron 15b Thinker Chatml
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
NE
OpenMath Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
NE
Nemotron 3 8b Chat 4k Sft Hf
Nemotron · mradermacher
Params8.54B
Context4K
Q4_K_M5.4 GB
GGUF
NE
OpenReasoning Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoning
NE
Nemotron Cascade 14B Thinking
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
NE
Openreasoning-Nemotron-32B
Nemotron · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingReasoning
NE
OpenMath Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
NE
Nemotron 3.5 Lightning 30B A3B Cricket Reasoning
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
NVIDIA Nemotron Labs 3 Elastic 12B A2B
Nemotron · mradermacher
Params12.4B
Context1024K
Q4_K_M9.6 GB
ReasoningTool use
NE
Nemotron Terminal 32B
Nemotron · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
CodingReasoningTool use
NE
OpenMath Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning

Keep browsing