Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Rombos LLM V2.6 Nemotron 70b
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
NE
Nemotron 3.5 Bolt E4B NVFP4 VisionAudio
Nemotron · arvedo
Params7.52B
Context128K
Smallest0.4 GB
ReasoningTool useVision
NE
OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B fit16gib
Nemotron · Alberto-Codes
Params31.6B
Context1024K
Smallest16.9 GB
ReasoningTool use
NE
Nemotron Cc Finnish Tower72B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
Nemotron-3-Diarization
Nemotron · vibe-app
Params99M
Context—
Smallest0.1 GB
GGUF
NE
OpenMath Nemotron 7B
Nemotron · DevQuasar-13
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B DSpark
Nemotron · magnitudedev
Params1.21B
Context1024K
Smallest1.3 GB
ReasoningTool useVision
NE
OpenCodeReasoning Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
OpenCodeReasoning Nemotron 32B IOI
Nemotron · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
AIS Gamma Nemotron Reasoning Code TIES 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
CodingReasoning
NE
Ministral 3B Diff TinyStories
Nemotron · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
NE
OpenMath Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
NE
nvidia.Nemotron Cascade 8B Thinking
Nemotron · DevQuasar
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
NE
Snowpiercer 15B v3
Nemotron · TheDrummer
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
NE
OpenReasoning Nemotron 7B
Nemotron · DevQuasar
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
NE
Nemotron Terminal 32B
Nemotron · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
CodingReasoningTool use
NE
Nemotron Mini 4B Instruct
Nemotron · DevQuasar-5
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
nemotron 3 nano 4b arkey
Nemotron · JulianAbeleda
Params3.97B
Context1024K
Smallest2.8 GB
ReasoningTool use
NE
Fast OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
nvidia.Nemotron Terminal 14B
Nemotron · DevQuasar
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
NE
nemotron terminal 14b tauriv2
Nemotron · impacte
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
Nemotron 3 Nano Omni 30B Text Only
Nemotron · batiai
Params31.6B
Context1024K
Smallest17.9 GB
ReasoningTool use
NE
OpenMath Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
OpenMath Nemotron 14B Kaggle
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
nemotron nano 4b writing style 2epoch
Nemotron · StratumAnalysisGroup
Params4.51B
Context128K
Q4_K_M2.8 GB
Tool use
NE
OpenCodeReasoning Nemotron 32B
Nemotron · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
nvidia.Orchestrator 8B
Nemotron · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
nemotron 3.5 asr streaming slovenian
Nemotron · texdata
Params638M
Context—
Smallest1.0 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B MTP
Nemotron · h1st0ry3D
Params2.04B
Context1024K
Q4_K_M1.8 GB
GGUF

Keep browsing