Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
Nemotron SEA LION v4.8 120B A12B
Nemotron · aisingapore
Params124B
Context1024K
Q4_K_M70.1 GB
NE
Nemotron Nano 30b A3B Clinical Instruct
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
Nemotron Cascade 2 96E A3B
Nemotron · mradermacher
Params24.2B
Context1024K
Q4_K_M18.8 GB
NE
Nemotron 3.5 30B A3B Antislop FTPO
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
aegisplan nemotron nano 9b
Nemotron · VenuArvind
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
NVIDIA Nemotron Labs 3 Elastic 12B A2B
Nemotron · mradermacher
Params12.4B
Context1024K
Q4_K_M9.6 GB
NE
Nemotron3 Nano 4B Uncensored HauhauCS Aggressive GenRM
Nemotron · HauhauCS
Params3.97B
Context1024K
Smallest2.2 GB
NE
OpenReasoning Nemotron 7B
Nemotron · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
OpenMath Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
NE
Nemotron 3 Embed 1B BF16
Nemotron · NeoRoth
Params1.14B
Context256K
Q4_K_M0.7 GB
NE
Nemotron Labs 3 Puzzle 75B A9B APEX
Nemotron · Myric
Params75.4B
Context1024K
Smallest31.0 GB
NE
NVIDIA-NemotronLabs-RE-USE
Nemotron · sakasegawa
Params10M
Context—
Smallest0.0 GB
NE
Nemotron 3.5 Transcribe AIPod HF
Nemotron · manateelazycat
Params784M
Context—
Smallest1.7 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · gaianet
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
OpenReasoning Nemotron 1.5B F32
Nemotron · prithivMLmods
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
NVIDIA Nemotron 3.5 30B A3B Fractal 64 CPU
Nemotron · Synchopate
Params31.6B
Context1024K
Smallest15.4 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B ROCmFP4
Nemotron · julianmb
Params31.6B
Context256K
Smallest16.8 GB
NE
KnowRL Nemotron 1.5B
Nemotron · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
NE
nemotron-czech-0.6b-v1.q8_0
Nemotron · twobe3
Params648M
Context—
Smallest0.7 GB
NE
Nemotron Cascade 2 96E A3B
Nemotron · mradermacher
Params24.2B
Context1024K
Q4_K_M18.8 GB
NE
AceReason Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
nvidia.AceReason Nemotron 14B
Nemotron · DevQuasar
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
OpenReasoning Nemotron 14B
Nemotron · DevQuasar
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
Rombos LLM V2.6 Nemotron 70b
Nemotron · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Ektome Nemotron Nano 8B PristinelyUncensored
Nemotron · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
OpenCodeReasoning Nemotron 14B
Nemotron · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
OpenCodeReasoning Nemotron 1.1 32B
Nemotron · gabriellarson
Params32.8B
Context64K
Q4_K_M19.9 GB
NE
AceReason Nemotron 1.1 Off policy GRPO 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Fast OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
Nemotron Cascade 14B Thinking
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB