Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
OpenCodeReasoning Nemotron 1.1 7B
Nemotron · gabriellarson
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
Nvidia-Nemotron-3.5-Lightning-30B-A3B
Nemotron · BoldingBuilds
Params35.2B
Context1024K
Smallest12.6 GB
ReasoningTool use
NE
Nemotron Nano 9B v2 Heretic
Nemotron · slaveyard
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
Nemotron Terminal 14B
Nemotron · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
AceMath RL Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NE
Nemotron SEA LION v4.8 30B A3B Base
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Nemotron 3.5 Bolt 5GB
Nemotron · inference-snaps
Params74B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
NE
AceReason Nemotron 1.1 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
nvidia.NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · DevQuasar
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · weathermanj
Params8.89B
Context1024K
Q4_K_M6.5 GB
GGUF
NE
OpenMath Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
NE
EntroPIC Nemotron 1.5b i1
Nemotron · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
NE
soc triage nemotron bolt e4b lora
Nemotron · infosecn1nja
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 12B v2 VL
Nemotron · tomlawrence
Params12.3B
Context1024K
Smallest7.1 GB
ReasoningTool useVision
NE
Nemotron 3 Nano Omni AEON Ultimate Uncensored BF16
Nemotron · kainecorneko
Params31.6B
Context1024K
Smallest19.8 GB
ReasoningTool useVision
NE
NVIDIA Nemotron Labs Dory1.0 4B heretic
Nemotron · somenetworktrouble
Params3.98B
Context256K
Smallest0.0 GB
GGUF
NE
Nemotron 3.5 Lightning 30B A3B Heretic Uncensored Q8 0
Nemotron · mlasli
Params31.6B
Context1024K
Smallest33.6 GB
ReasoningRoleplayTool use
NE
Nemotron 3.5 Rerank 8B
Nemotron · netprojects
Params7.95B
Context256K
Q4_K_M4.9 GB
Embedding
NE
nvidia.NVIDIA Nemotron Nano 12B v2
Nemotron · DevQuasar
Params12.3B
Context1024K
Q4_K_M7.5 GB
ReasoningTool use
NE
Nemotron Cascade 2 30B A3B Heretic
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Nemotron 9B OpenCode
Nemotron · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
NE
Koleslaw Nemotron 30B A3B PromptEnhance
Nemotron · thunkaboutit
Params31.6B
Context1024K
Smallest18.2 GB
CodingReasoningTool use
NE
AceReason Nemotron 1.1 Off policy GRPO 7B i1
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
NE
OpenCodeReasoning Nemotron 1.1 7B imatrix
Nemotron · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4 LiLiCorr
Nemotron · lmstudio-community
Params1.66B
Context1024K
Smallest1.4 GB
ReasoningTool useVision
NE
Nemotron-Cascade-2-30B-A3B
Nemotron · Mungert
Params31.6B
Context1024K
Q4_K_M23.9 GB
ReasoningTool use
NE
OpenMath Nemotron 32B
Nemotron · DevQuasar-13
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
NE
Nemotron74ba9
Nemotron · HelloSun
Params74B
Context256K
Smallest22.0 GB
ReasoningTool useVision
NE
AceReason Nemotron 1.1 7B
Nemotron · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
Nemotron Cascade 8B
Nemotron · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use

Keep browsing