Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
OpenCodeReasoning Nemotron 1.1 7B
Nemotron · gabriellarson
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
Nvidia-Nemotron-3.5-Lightning-30B-A3B
Nemotron · BoldingBuilds
Params35.2B
Context1024K
Smallest12.6 GB
NE
Nemotron Nano 9B v2 Heretic
Nemotron · slaveyard
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
Nemotron Terminal 14B
Nemotron · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
NE
AceMath RL Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Nemotron SEA LION v4.8 30B A3B Base
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
Nemotron 3.5 Bolt 5GB
Nemotron · inference-snaps
Params74B
Context128K
Q4_K_M5.3 GB
NE
AceReason Nemotron 1.1 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
nvidia.NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · DevQuasar
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · weathermanj
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
OpenMath Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
EntroPIC Nemotron 1.5b i1
Nemotron · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
NE
soc triage nemotron bolt e4b lora
Nemotron · infosecn1nja
Params7.52B
Context128K
Q4_K_M5.3 GB
NE
NVIDIA Nemotron Nano 12B v2 VL
Nemotron · tomlawrence
Params12.3B
Context1024K
Smallest7.1 GB
NE
Nemotron 3 Nano Omni AEON Ultimate Uncensored BF16
Nemotron · kainecorneko
Params31.6B
Context1024K
Smallest19.8 GB
NE
NVIDIA Nemotron Labs Dory1.0 4B heretic
Nemotron · somenetworktrouble
Params3.98B
Context256K
Smallest0.0 GB
NE
Nemotron 3.5 Lightning 30B A3B Heretic Uncensored Q8 0
Nemotron · mlasli
Params31.6B
Context1024K
Smallest33.6 GB
NE
Nemotron 3.5 Rerank 8B
Nemotron · netprojects
Params7.95B
Context256K
Q4_K_M4.9 GB
NE
nvidia.NVIDIA Nemotron Nano 12B v2
Nemotron · DevQuasar
Params12.3B
Context1024K
Q4_K_M7.5 GB
NE
Nemotron Cascade 2 30B A3B Heretic
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
Nemotron 9B OpenCode
Nemotron · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
NE
Koleslaw Nemotron 30B A3B PromptEnhance
Nemotron · thunkaboutit
Params31.6B
Context1024K
Smallest18.2 GB
NE
AceReason Nemotron 1.1 Off policy GRPO 7B i1
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
OpenCodeReasoning Nemotron 1.1 7B imatrix
Nemotron · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4 LiLiCorr
Nemotron · lmstudio-community
Params1.66B
Context1024K
Smallest1.4 GB
NE
Nemotron-Cascade-2-30B-A3B
Nemotron · Mungert
Params31.6B
Context1024K
Q4_K_M23.9 GB
NE
OpenMath Nemotron 32B
Nemotron · DevQuasar-13
Params32.8B
Context128K
Q4_K_M19.9 GB
NE
Nemotron74ba9
Nemotron · HelloSun
Params74B
Context256K
Smallest22.0 GB
NE
AceReason Nemotron 1.1 7B
Nemotron · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Nemotron Cascade 8B
Nemotron · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB