Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
nvidia.AceReason Nemotron 1.1 7B
Nemotron · DevQuasar
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
NE
OpenReasoning Nemotron 32B
Nemotron · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
NE
OpenCodeReasoning Nemotron 7B
Nemotron · lmstudio-community
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
NVIDIA Nemotron 3 Super 120B A12B NVFP4
Nemotron · grumd0
Params121B
Context1024K
Smallest72.1 GB
ReasoningTool use
NE
OpenReasoning Nemotron 1.5B
Nemotron · lmstudio-community
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
NE
Nemotron Cascade 8B Thinking
Nemotron · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
NE
AceReason Nemotron 7B
Nemotron · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NE
NVIDIA-Nemotron-3-Super-120B-A12B
Nemotron · vultr
Params121B
Context1024K
Q4_K_M94.6 GB
ReasoningTool use
NE
Nemotron Research GooseReason 4B Instruct Heretic v2
Nemotron · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
CodingReasoningTool use
NE
Nemotron 49b v1 Intern NLQ Merged
Nemotron · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
NE
Mirage OpenReasoning Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
NE
AceReason Nemotron 7B
Nemotron · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
Nemotron 3 Nano Omni 30B A3B Reasoning TurboQuant GGUF MXFP4 MOE
Nemotron · majentik
Params31.6B
Context1024K
Smallest18.0 GB
ReasoningTool useVision
NE
AceReason Nemotron 14B
Nemotron · lmstudio-community
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
Nemotron-3 Diarization
Nemotron · Glimpse-Dictation
Params99M
Context—
Smallest0.1 GB
GGUF
NE
OpenMath Nemotron 7B
Nemotron · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
NE
Models Nvidia NVIDIA Nemotron Nano 9B v2
Nemotron · MaziyarPanahi
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
NE
Nemotron Mini 4B Instruct
Nemotron · gaianet
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
EntroPIC Nemotron 1.5b
Nemotron · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
NE
Nemotron3-Nano-4B-Uncensored-HauhauCS-Aggressive
Nemotron · chu1423414671
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
AceReason Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
NE
NVIDIA Nemotron 3 Ultra 550B A55B
Nemotron · hell0ks
Params549B
Context1024K
Smallest0.7 GB
GGUF
NE
OpenCodeReasoning Nemotron 7B i1
Nemotron · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
NVIDIA Nemotron 3 Super 120B A12B NVFP4
Nemotron · jdziat
Params121B
Context1024K
Smallest68.2 GB
ReasoningTool use
NE
ServiceNow AI.Apriel Nemotron 15b Thinker
Nemotron · DevQuasar
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
NE
NVIDIA Nemotron Labs Dory1.0 4B
Nemotron · Cenedril
Params3.98B
Context256K
Smallest3.7 GB
ReasoningTool use
NE
Nemotron-3.5-Bolt-74B-A9B
Nemotron · magnitudedev
Params835M
Context256K
Smallest0.8 GB
GGUF
NE
mongolian stt asr nemotron v13m
Nemotron · sergei10a
Params639M
Context—
Smallest0.9 GB
GGUF
NE
OpenMath Nemotron 32B
Nemotron · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning

Keep browsing