Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron SEA LION v4.8 120B A12B
Nemotron · aisingapore
Params124B
Context1024K
Q4_K_M70.1 GB
ReasoningTool use
NE
Nemotron Nano 30b A3B Clinical Instruct
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
CodingReasoningTool use
NE
Nemotron Cascade 2 96E A3B
Nemotron · mradermacher
Params24.2B
Context1024K
Q4_K_M18.8 GB
ReasoningTool use
NE
Nemotron 3.5 30B A3B Antislop FTPO
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
aegisplan nemotron nano 9b
Nemotron · VenuArvind
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
NVIDIA Nemotron Labs 3 Elastic 12B A2B
Nemotron · mradermacher
Params12.4B
Context1024K
Q4_K_M9.6 GB
ReasoningTool use
NE
Nemotron3 Nano 4B Uncensored HauhauCS Aggressive GenRM
Nemotron · HauhauCS
Params3.97B
Context1024K
Smallest2.2 GB
ReasoningTool use
NE
OpenReasoning Nemotron 7B
Nemotron · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
NE
OpenMath Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
NE
Nemotron 3 Embed 1B BF16
Nemotron · NeoRoth
Params1.14B
Context256K
Q4_K_M0.7 GB
Embedding
NE
Nemotron Labs 3 Puzzle 75B A9B APEX
Nemotron · Myric
Params75.4B
Context1024K
Smallest31.0 GB
ReasoningTool use
NE
NVIDIA-NemotronLabs-RE-USE
Nemotron · sakasegawa
Params10M
Context—
Smallest0.0 GB
GGUF
NE
Nemotron 3.5 Transcribe AIPod HF
Nemotron · manateelazycat
Params784M
Context—
Smallest1.7 GB
GGUF
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · gaianet
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
OpenReasoning Nemotron 1.5B F32
Nemotron · prithivMLmods
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingReasoning
NE
NVIDIA Nemotron 3.5 30B A3B Fractal 64 CPU
Nemotron · Synchopate
Params31.6B
Context1024K
Smallest15.4 GB
CodingReasoningTool use
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B ROCmFP4
Nemotron · julianmb
Params31.6B
Context256K
Smallest16.8 GB
GGUF
NE
KnowRL Nemotron 1.5B
Nemotron · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
NE
nemotron-czech-0.6b-v1.q8_0
Nemotron · twobe3
Params648M
Context—
Smallest0.7 GB
GGUF
NE
Nemotron Cascade 2 96E A3B
Nemotron · mradermacher
Params24.2B
Context1024K
Q4_K_M18.8 GB
ReasoningTool use
NE
AceReason Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NE
nvidia.AceReason Nemotron 14B
Nemotron · DevQuasar
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
NE
OpenReasoning Nemotron 14B
Nemotron · DevQuasar
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
Rombos LLM V2.6 Nemotron 70b
Nemotron · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
NE
Ektome Nemotron Nano 8B PristinelyUncensored
Nemotron · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
NE
OpenCodeReasoning Nemotron 14B
Nemotron · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
OpenCodeReasoning Nemotron 1.1 32B
Nemotron · gabriellarson
Params32.8B
Context64K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
AceReason Nemotron 1.1 Off policy GRPO 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
NE
Fast OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
Nemotron Cascade 14B Thinking
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use

Keep browsing