Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
nvidia.OpenCodeReasoning Nemotron 32B IOI
Nemotron · DevQuasar
Params32.8B
Context32K
Q4_K_M19.9 GB
NE
AceReason Nemotron 1.1 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Nemotron-4-Mini-Hindi-4B-Instruct
Nemotron · Mungert
Params4.19B
Context4K
Q4_K_M2.9 GB
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-DFlash-NVFP4
Nemotron · apolo13x
Params833M
Context1024K
Smallest1.2 GB
NE
PhoneLLM Alpha 1 ROCmFP4
Nemotron · kingjones777
Params31.6B
Context1024K
Smallest17.0 GB
NE
Sirius N4
Nemotron · SiriusLLM
Params4.19B
Context4K
Q4_K_M2.7 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
AEON 7_Nemotron 3 Nano Omni AEON Ultimate Uncensored BF16
Nemotron · wazimondo
Params31.6B
Context1024K
Smallest33.5 GB
NE
OpenCodeReasoning Nemotron 32B IOI
Nemotron · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
NE
OpenReasoning Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
NE
nvidia.NVIDIA Nemotron 3 Nano 4B BF16
Nemotron · DevQuasar
Params3.97B
Context1024K
Smallest2.2 GB
NE
Apriel Nemotron 15b Thinker Magic_decensored_MPOA
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
NE
nemotron car diagnostics
Nemotron · build-small-hackathon
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
Nemotron Research GooseReason 4B Instruct Heretic
Nemotron · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · SoAIHQ
Params3.97B
Context256K
Q4_K_M2.8 GB
NE
Nemotron 3.5 Lightning 30B A3B NVFP4
Nemotron · WhiskyAKM
Params32.9B
Context1024K
Smallest0.7 GB
NE
Big Alice 28B v1
Nemotron · TheDrummer
Params28.6B
Context64K
Q4_K_M17.3 GB
NE
QuestA Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
Nemotron Religionfighter 12x4B
Nemotron · mradermacher
Params38.7B
Context128K
Q4_K_M23.5 GB
NE
Nemotron Dpo
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Fastino Nemotron 3.5 Lightning Finance
Nemotron · hemono
Params31.6B
Context1024K
Smallest18.9 GB
NE
Nemotron-3-Nano-Omni-30B-A3B-Reasoning
Nemotron · vultr
Params31.6B
Context1024K
Q4_K_M27.0 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · gabriellarson
Params12.3B
Context1024K
Q4_K_M7.5 GB
NE
Nemotron Cascade 8B Thinking Claude 4.5 Opus High Reasoning Distill
Nemotron · ronaldcmz
Params8.19B
Context32K
Q4_K_M5.0 GB
NE
NVIDIA Nemotron 3 Super 120B A12B
Nemotron · AesSedai
Params121B
Context1024K
Smallest0.3 GB
NE
spartan nemotron i1
Nemotron · mradermacher
Params29.5B
Context128K
Q4_K_M17.9 GB
NE
nvidia.Nemotron Terminal 32B
Nemotron · DevQuasar
Params32.8B
Context40K
Q4_K_M19.8 GB
NE
spartan nemotron
Nemotron · mradermacher
Params29.5B
Context128K
Q4_K_M17.9 GB
NE
OpenCodeReasoning Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
NE
Nemotron Cc Icelandic Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB