Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Nvidia-Nemotron-3-Nano-Omni-30B-A3B-Reasoning
Nemotron · MuVeraAI
Params31.6B
Context1024K
Q4_K_M23.9 GB
ReasoningTool useVision
NE
Nemotron 3 Nano 30B TAIDE zhTW Uncensored
Nemotron · xCloudinfo
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Nemotron-4-Mini-Hindi-4B-Base
Nemotron · Mungert
Params4.19B
Context4K
Q4_K_M2.9 GB
Tool use
NE
Nemotron 70b Math v1
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
NE
Nemotron 3 Embed 1B
Nemotron · nanoandrew4
Params1.14B
Context256K
Smallest1.2 GB
Embedding
NE
nvidia.NVIDIA Nemotron Nano 9B v2
Nemotron · DevQuasar
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
Nemotron 3.5 30B A3B Antislop FTPO
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
OpenMath Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
NE
Nemotron Mini 4B Instruct
Nemotron · QuantFactory
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
Orchestrator 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
Kairos
Nemotron · squ11z1
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
NE
Nemotron 3 Content Safety
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
NE
AceMath-RL-Nemotron-7B
Nemotron · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
ReasoningTool use
NE
nvidia.AceMath RL Nemotron 7B
Nemotron · DevQuasar-13
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
NE
Nemotron Orchestrator 8B Claude 4.5 Opus Distill
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
NVIDIA Nemotron Labs 3 Puzzle 75B A9B MTP
Nemotron · MRockatansky
Params78.3B
Context1024K
Smallest45.3 GB
ReasoningTool use
NE
GaMS 9B Instruct Nemotron
Nemotron · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Nemotron · vultr
Params31.6B
Context1024K
Q4_K_M27.0 GB
ReasoningTool use
NE
OpenMath Nemotron 14B Kaggle
Nemotron · DevQuasar-13
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
NE
Openhands Nemotron 32B Karcher
Nemotron · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
NE
Nemotron-3-Super-64B-A12B-Math-REAP
Nemotron · Max-and-Omnis
Params64.3B
Context1024K
Q4_K_M55.6 GB
ReasoningTool use
NE
OpenReasoning Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
NE
Nemotron Cascade 14B Thinking Claude 4.5 Opus High Reasoning Distill
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
NE
Nemotron 15b Thinker v0.1
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
NE
Nemotron Terminal 14B
Nemotron · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
nvidia.NVIDIA Nemotron Nano 12B v2 Base
Nemotron · DevQuasar
Params12.3B
Context1024K
Q4_K_M7.5 GB
GGUF
NE
L3.1 nemotron sunfall v0.7.0
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
NE
AceReason Nemotron 1.1 7B
Nemotron · gabriellarson
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Nemotron · gbuzhf
Params32.9B
Context1024K
Smallest19.3 GB
ReasoningTool use

Keep browsing