Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
Nvidia-Nemotron-3-Nano-Omni-30B-A3B-Reasoning
Nemotron · MuVeraAI
Params31.6B
Context1024K
Q4_K_M23.9 GB
NE
Nemotron 3 Nano 30B TAIDE zhTW Uncensored
Nemotron · xCloudinfo
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
Nemotron-4-Mini-Hindi-4B-Base
Nemotron · Mungert
Params4.19B
Context4K
Q4_K_M2.9 GB
NE
Nemotron 70b Math v1
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Nemotron 3 Embed 1B
Nemotron · nanoandrew4
Params1.14B
Context256K
Smallest1.2 GB
NE
nvidia.NVIDIA Nemotron Nano 9B v2
Nemotron · DevQuasar
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
Nemotron 3.5 30B A3B Antislop FTPO
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
OpenMath Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
Nemotron Mini 4B Instruct
Nemotron · QuantFactory
Params4.19B
Context4K
Q4_K_M2.7 GB
NE
Orchestrator 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
NE
Kairos
Nemotron · squ11z1
Params8.19B
Context32K
Q4_K_M5.0 GB
NE
Nemotron 3 Content Safety
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
NE
AceMath-RL-Nemotron-7B
Nemotron · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
NE
nvidia.AceMath RL Nemotron 7B
Nemotron · DevQuasar-13
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
NE
Nemotron Orchestrator 8B Claude 4.5 Opus Distill
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
NE
NVIDIA Nemotron Labs 3 Puzzle 75B A9B MTP
Nemotron · MRockatansky
Params78.3B
Context1024K
Smallest45.3 GB
NE
GaMS 9B Instruct Nemotron
Nemotron · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Nemotron · vultr
Params31.6B
Context1024K
Q4_K_M27.0 GB
NE
OpenMath Nemotron 14B Kaggle
Nemotron · DevQuasar-13
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
Openhands Nemotron 32B Karcher
Nemotron · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
NE
Nemotron-3-Super-64B-A12B-Math-REAP
Nemotron · Max-and-Omnis
Params64.3B
Context1024K
Q4_K_M55.6 GB
NE
OpenReasoning Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Nemotron Cascade 14B Thinking Claude 4.5 Opus High Reasoning Distill
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
Nemotron 15b Thinker v0.1
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
NE
Nemotron Terminal 14B
Nemotron · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
NE
nvidia.NVIDIA Nemotron Nano 12B v2 Base
Nemotron · DevQuasar
Params12.3B
Context1024K
Q4_K_M7.5 GB
NE
L3.1 nemotron sunfall v0.7.0
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
AceReason Nemotron 1.1 7B
Nemotron · gabriellarson
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Nemotron · gbuzhf
Params32.9B
Context1024K
Smallest19.3 GB