Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron-Cascade-8B
Nemotron · JustACluelessKid2
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
NE
Snowpiercer 15B v2
Nemotron · TheDrummer
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
NE
privacy-filter-nemotron-v2
Nemotron · Owlchemy
Params1.4B
Context128K
Smallest1.6 GB
GGUF
NE
OpenCodeReasoning Nemotron 1.1 7B
Nemotron · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
GaMS 27B Instruct Nemotron
Nemotron · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
NE
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
Nemotron · vultr
Params121B
Context1024K
Q4_K_M94.6 GB
ReasoningTool useVision
NE
Nemotron 3.5 Bolt E4B
Nemotron · manateelazycat
Params7.52B
Context64K
Q4_K_M6.2 GB
ReasoningTool use
NE
JustRL Nemotron 1.5B
Nemotron · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
NE
nvidia.Nemotron Elastic 12B
Nemotron · DevQuasar
Params12.3B
Context1024K
Q4_K_M7.5 GB
ReasoningTool use
NE
OpenResearcher 30B A3B
Nemotron · OpenResearcher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
OpenReasoning Nemotron 7B
Nemotron · gabriellarson
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
NE
AceReason Nemotron 1.1 7B
Nemotron · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
NE
ServiceNow AI Apriel Nemotron 15b Thinker Chatml
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · prithivMLmods
Params32.9B
Context1024K
Smallest25.4 GB
ReasoningTool use
NE
OpenReasoning Nemotron 32B
Nemotron · gabriellarson
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingReasoning
NE
Nemotron Research GooseReason 4B Instruct heretic
Nemotron · daydreamwarrior
Params4.02B
Context256K
Smallest3.3 GB
Tool use
NE
Nemotron Cascade 2 30B A3B Heretic
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
nvidia.Nemotron Cascade 14B Thinking
Nemotron · DevQuasar
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
NE
NVIDIA Nemotron 3 Nano 4B BF16
Nemotron · ggml-org
Params3.97B
Context1024K
Smallest4.2 GB
ReasoningTool use
NE
Nemotron Mini 4B Instruct
Nemotron · mradermacher
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
nemotron mini 4b claude distilled
Nemotron · Theerrthesh
Params4.51B
Context128K
Q4_K_M2.8 GB
Tool use
NE
OpenMath Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
NE
OpenReasoning Nemotron 1.5B
Nemotron · DevQuasar
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B 24GB
Nemotron · marafx2007
Params74B
Context256K
Smallest22.0 GB
ReasoningTool useVision
NE
NVIDIA-Nemotron-3.5-Bolt-E4B
Nemotron · Harsha001
Params7.52B
Context128K
Smallest4.1 GB
ReasoningTool use
NE
Nemotron 3 Nano Omni 30B Abliterated MM
Nemotron · wacomctl672
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
nvidia.OpenCodeReasoning Nemotron 1.1 32B
Nemotron · DevQuasar
Params32.8B
Context64K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
Nemotron Mini 4B Instruct
Nemotron · brittlewis12
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
Nemotron-Labs-Diffusion-3B
Nemotron · IntellAgents
Params3.83B
Context256K
Q4_K_M2.4 GB
ReasoningTool use
NE
Nemotron 3 Nano Omni AEON Ultimate Uncensored BF16
Nemotron · kainecorneko
Params31.6B
Context1024K
Smallest24.5 GB
ReasoningTool useVision

Keep browsing