Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
Rombos LLM V2.6 Nemotron 70b
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Nemotron 3.5 Bolt E4B NVFP4 VisionAudio
Nemotron · arvedo
Params7.52B
Context128K
Smallest0.4 GB
NE
OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B fit16gib
Nemotron · Alberto-Codes
Params31.6B
Context1024K
Smallest16.9 GB
NE
Nemotron Cc Finnish Tower72B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
Nemotron-3-Diarization
Nemotron · vibe-app
Params99M
Context—
Smallest0.1 GB
NE
OpenMath Nemotron 7B
Nemotron · DevQuasar-13
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B DSpark
Nemotron · magnitudedev
Params1.21B
Context1024K
Smallest1.3 GB
NE
OpenCodeReasoning Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
OpenCodeReasoning Nemotron 32B IOI
Nemotron · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
NE
AIS Gamma Nemotron Reasoning Code TIES 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
NE
Ministral 3B Diff TinyStories
Nemotron · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
NE
OpenMath Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
NE
nvidia.Nemotron Cascade 8B Thinking
Nemotron · DevQuasar
Params8.19B
Context32K
Q4_K_M5.0 GB
NE
Snowpiercer 15B v3
Nemotron · TheDrummer
Params15B
Context64K
Q4_K_M9.1 GB
NE
OpenReasoning Nemotron 7B
Nemotron · DevQuasar
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Nemotron Terminal 32B
Nemotron · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
NE
Nemotron Mini 4B Instruct
Nemotron · DevQuasar-5
Params4.19B
Context4K
Q4_K_M2.7 GB
NE
nemotron 3 nano 4b arkey
Nemotron · JulianAbeleda
Params3.97B
Context1024K
Smallest2.8 GB
NE
Fast OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
nvidia.Nemotron Terminal 14B
Nemotron · DevQuasar
Params14.8B
Context40K
Q4_K_M9.0 GB
NE
nemotron terminal 14b tauriv2
Nemotron · impacte
Params14.8B
Context40K
Q4_K_M9.0 GB
NE
Nemotron 3 Nano Omni 30B Text Only
Nemotron · batiai
Params31.6B
Context1024K
Smallest17.9 GB
NE
OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
OpenMath Nemotron 14B Kaggle
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
nemotron nano 4b writing style 2epoch
Nemotron · StratumAnalysisGroup
Params4.51B
Context128K
Q4_K_M2.8 GB
NE
OpenCodeReasoning Nemotron 32B
Nemotron · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
NE
nvidia.Orchestrator 8B
Nemotron · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
NE
nemotron 3.5 asr streaming slovenian
Nemotron · texdata
Params638M
Context—
Smallest1.0 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B MTP
Nemotron · h1st0ry3D
Params2.04B
Context1024K
Q4_K_M1.8 GB