Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron nano 4b escape room
Nemotron · build-small-hackathon
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
Nemotron-3.5-Bolt-E4B-Heretic
Nemotron · Austriani
Params7.46B
Context64K
Smallest4.0 GB
ReasoningTool use
NE
nemotron dory1.0 4b
Nemotron · nile-academy
Params3.98B
Context256K
Smallest3.7 GB
ReasoningTool use
NE
Nvidia-Nemotron-3.5-Lightning-30B-A3B
Nemotron · BoldingBuilds
Params35.2B
Context1024K
Smallest12.6 GB
ReasoningTool use
NE
nvidia.Nemotron 3 Nano Omni 30B A3B Reasoning BF16
Nemotron · DevQuasar
Params31.6B
Context1024K
Smallest17.9 GB
ReasoningTool useVision
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B APEX
Nemotron · Myric
Params32.9B
Context1024K
Smallest14.7 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · WhiskyAKM
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
MetisRCA E4B
Nemotron · ThakiCloud
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool useVision
NE
Openbuddy Nemotron 70b v23.1 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
Nemotron Nano 9B v2 Heretic
Nemotron · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
NDP Nemotron 3 Nano 4B tool calling
Nemotron · shazzadulimun
Params3.97B
Context1024K
Q4_K_M2.8 GB
CodingReasoningTool use
NE
OpenMath Nemotron 14B
Nemotron · DevQuasar-13
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
NE
OpenReasoning Nemotron 14B
Nemotron · lmstudio-community
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
Nemotron Research GooseReason 4B Instruct Heretic v2
Nemotron · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
CodingReasoningTool use
NE
nemotron 3 nano 4b
Nemotron · nile-academy
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
NVIDIA Nemotron 3 Nano Omni 30B A3B Reasoning NVFP4
Nemotron · FedericoFB
Params31.6B
Context1024K
Smallest21.0 GB
ReasoningTool useVision
NE
Nemotron3-Nano-4B-Uncensored-HauhauCS-Aggressive
Nemotron · Unrestricted
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
nvidia.Nemotron Cascade 8B
Nemotron · DevQuasar
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
NE
Nemotron Mini 4B Instruct
Nemotron · MaziyarPanahi
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · tatsuyaaaaaaa
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
nvidia.Nemotron Cascade 2 30B A3B
Nemotron · DevQuasar
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Nemotron Cascade 14B Thinking Claude 4.5 Opus High Reasoning Distill
Nemotron · TeichAI
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
NE
Nemotron Mini 4B Instruct i1
Nemotron · mradermacher
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
Nemotron 3 Content Safety
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
NE
Nemotron Cascade 2 30B A3B
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
Reasoning
NE
OpenCodeReasoning Nemotron 1.1 32B i1
Nemotron · mradermacher
Params32.8B
Context64K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
Nemotron Terminal 14B Heretic
Nemotron · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
OpenReasoning Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingReasoning
NE
OpenCodeReasoning Nemotron 1.1 14B
Nemotron · mradermacher
Params14.8B
Context64K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
OpenCodeReasoning Nemotron 14B i1
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoningTool use

Keep browsing