Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · mmnga-o
Params8.89B
Context1024K
Q4_K_M6.5 GB
GGUF
NE
Nemotron 3.5 Super 120B A12B NVFP4 Strata Blackwell
Nemotron · Cudecnik
Params124B
Context1024K
Smallest71.6 GB
ReasoningTool useVision
NE
Nemotron 3.5 Bolt 74B A9B 24GB Metal
Nemotron · UraionLabs
Params74B
Context256K
Smallest24.2 GB
ReasoningTool useVision
NE
Orchestrator 8B
Nemotron · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
NE
Nemotron 3 Embed 8B BF16
Nemotron · Aqua00
Params7.95B
Context256K
Q4_K_M4.9 GB
Embedding
NE
Nemotron H 8B Reasoning 128K
Nemotron · bartowski
Params8.1B
Context1024K
Q4_K_M5.0 GB
Reasoning
NE
AceReason Nemotron 1.1 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
NE
Nemotron Cascade 8B
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
Reasoning
NE
Nemotron 3.5 Lightning 30B A3B Uncensored xCloud
Nemotron · xCloudinfo
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B abliterated
Nemotron · IstroSec
Params32.9B
Context1024K
Smallest0.1 GB
GGUF
NE
nvidia OpenCodeReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoning
NE
Sakura Nemotron 3.5 Bolt 74B A9B 24GB Uncensored
Nemotron · webmp3
Params74B
Context256K
Smallest23.4 GB
GGUF
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
Nemotron · sakasegawa
Params33.7B
Context—
Smallest19.0 GB
GGUF
NE
nemotron 3.5 asr streaming
Nemotron · cstr
Params638M
Context—
Smallest0.4 GB
GGUF
NE
NVIDIA-Nemotron-3.5-Bolt-74B-DERISKED
Nemotron · freakyskittle
Params74B
Context1024K
Q4_K_M46.4 GB
Vision
NE
OpenReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
Heretic Nemotron Content Safety Reasoning 4B
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
NE
NVIDIA NemotronLabs VoiceChat 11B
Nemotron · hoidhxd
Params11.1B
Context—
Smallest0.3 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4 DFlash
Nemotron · magnitudedev
Params833M
Context1024K
Smallest1.2 GB
GGUF
NE
Nemotron-3-Nano-30B-A3B
Nemotron · mudler
Params31.6B
Context1024K
Smallest18.8 GB
GGUF
NE
Nemotron Cascade 14B Thinking
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Reasoning
NE
Nemotron Cascade 2 30B A3B
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
Reasoning
NE
OpenReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
NE
ThinkingCap NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
Nemotron 3 Super 120B A12B Uncensored
Nemotron · timteh673
Params121B
Context1024K
Q4_K_M86.1 GB
GGUF
NE
nvidia OpenCodeReasoning Nemotron 32B IOI
Nemotron · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoning
NE
addis scribe streaming
Nemotron · addisai
Params99M
Context—
Smallest0.0 GB
GGUF
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B
Nemotron · natalie5
Params1.63B
Context1024K
Smallest1.3 GB
Vision
NE
OpenMath Nemotron 14B Kaggle
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · vcruz305
Params31.6B
Context1024K
Smallest9.8 GB
GGUF

Keep browsing