Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
nvidia.OpenCodeReasoning Nemotron 32B IOI
Nemotron · DevQuasar
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
AceReason Nemotron 1.1 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
Nemotron-4-Mini-Hindi-4B-Instruct
Nemotron · Mungert
Params4.19B
Context4K
Q4_K_M2.9 GB
Tool use
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-DFlash-NVFP4
Nemotron · apolo13x
Params833M
Context1024K
Smallest1.2 GB
ReasoningTool use
NE
PhoneLLM Alpha 1 ROCmFP4
Nemotron · kingjones777
Params31.6B
Context1024K
Smallest17.0 GB
ReasoningTool use
NE
Sirius N4
Nemotron · SiriusLLM
Params4.19B
Context4K
Q4_K_M2.7 GB
GGUF
NE
OpenReasoning Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingReasoning
NE
AEON 7_Nemotron 3 Nano Omni AEON Ultimate Uncensored BF16
Nemotron · wazimondo
Params31.6B
Context1024K
Smallest33.5 GB
ReasoningTool useVision
NE
OpenCodeReasoning Nemotron 32B IOI
Nemotron · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
OpenReasoning Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingReasoning
NE
nvidia.NVIDIA Nemotron 3 Nano 4B BF16
Nemotron · DevQuasar
Params3.97B
Context1024K
Smallest2.2 GB
ReasoningTool use
NE
Apriel Nemotron 15b Thinker Magic_decensored_MPOA
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
NE
nemotron car diagnostics
Nemotron · build-small-hackathon
Params3.97B
Context1024K
Q4_K_M2.8 GB
CodingReasoningTool use
NE
Nemotron Research GooseReason 4B Instruct Heretic
Nemotron · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · SoAIHQ
Params3.97B
Context256K
Q4_K_M2.8 GB
ReasoningTool use
NE
Nemotron 3.5 Lightning 30B A3B NVFP4
Nemotron · WhiskyAKM
Params32.9B
Context1024K
Smallest0.7 GB
ReasoningTool use
NE
Big Alice 28B v1
Nemotron · TheDrummer
Params28.6B
Context64K
Q4_K_M17.3 GB
Reasoning
NE
QuestA Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
NE
Nemotron Religionfighter 12x4B
Nemotron · mradermacher
Params38.7B
Context128K
Q4_K_M23.5 GB
RoleplayTool use
NE
Nemotron Dpo
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
Fastino Nemotron 3.5 Lightning Finance
Nemotron · hemono
Params31.6B
Context1024K
Smallest18.9 GB
ReasoningTool use
NE
Nemotron-3-Nano-Omni-30B-A3B-Reasoning
Nemotron · vultr
Params31.6B
Context1024K
Q4_K_M27.0 GB
ReasoningTool useVision
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · gabriellarson
Params12.3B
Context1024K
Q4_K_M7.5 GB
ReasoningTool use
NE
Nemotron Cascade 8B Thinking Claude 4.5 Opus High Reasoning Distill
Nemotron · ronaldcmz
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
NE
NVIDIA Nemotron 3 Super 120B A12B
Nemotron · AesSedai
Params121B
Context1024K
Smallest0.3 GB
GGUF
NE
spartan nemotron i1
Nemotron · mradermacher
Params29.5B
Context128K
Q4_K_M17.9 GB
Tool use
NE
nvidia.Nemotron Terminal 32B
Nemotron · DevQuasar
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
NE
spartan nemotron
Nemotron · mradermacher
Params29.5B
Context128K
Q4_K_M17.9 GB
Tool use
NE
OpenCodeReasoning Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
Nemotron Cc Icelandic Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF

Keep browsing