Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B DSpark
Nemotron · meshllm
Params968M
Context1024K
Smallest1.0 GB
ReasoningTool use
NE
OpenMath Nemotron 1.5B
Nemotron · lmstudio-community
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · memoravox
Params638M
Context—
Smallest0.8 GB
GGUF
NE
nvidia_NVIDIA Nemotron 3 Nano 30B A3B FP8_local
Nemotron · modelfix
Params31.6B
Context1024K
Smallest24.5 GB
ReasoningTool use
NE
Nemotron 3 Nano Omni 30B A3B Reasoning TurboQuant GGUF Q5 K M
Nemotron · majentik
Params31.6B
Context1024K
Smallest26.0 GB
ReasoningTool useVision
NE
nemotron 3.5 asr ptbr
Nemotron · marcosremar2
Params648M
Context—
Smallest0.8 GB
GGUF
NE
gguf Q5 K M Nemotron Mini 4B Instruct
Nemotron · Felladrin
Params4.19B
Context4K
Smallest6.1 GB
Tool use
NE
nvidia.AceReason Nemotron 7B
Nemotron · DevQuasar
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NE
Nvidia-Nemotron-3-Super-120B-A12B
Nemotron · meshllm
Params124B
Context1024K
Smallest89.7 GB
ReasoningTool use
NE
Nemotron Cc Swe Opus
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
Nemotron Cc French Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
Nemotron 15b Thinker Instruct
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
NE
Q4 0 nemotron 3.5 asr streaming 0.6b
Nemotron · framadhita
Params638M
Context—
Smallest0.6 GB
GGUF
NE
Nemotron Orchestrator 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
OpenThai 2.0 Legal ThaiLLM Nemotron 3 Nano 30B A3B IQ4 NL
Nemotron · Naypa
Params31.6B
Context1024K
Smallest18.2 GB
ReasoningTool use
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · Doctoc-Health
Params638M
Context—
Smallest0.8 GB
GGUF
NE
Nemotron-Labs-Diffusion-VLM-8B
Nemotron · IntellAgents
Params8.49B
Context256K
Smallest17.0 GB
ReasoningTool useVision
NE
Nemotron Content Safety Reasoning 4B
Nemotron · ARM174G3
Params4.55B
Context128K
Smallest4.8 GB
Reasoning
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · willspeak
Params638M
Context—
Smallest0.6 GB
GGUF
NE
Nemotron Content Safety Reasoning 4B
Nemotron · AXONVERTEX-AI-RESEARCH
Params4.55B
Context128K
Smallest4.8 GB
Reasoning
NE
Nemotron3 Nano 4B Uncensored HauhauCS Aggressive GenRM
Nemotron · Unrestricted
Params3.97B
Context1024K
Smallest2.2 GB
ReasoningTool use
NE
Advisor
Nemotron · Orionfold
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
nemotron-3.5-asr-streaming-0.6b.q5_k
Nemotron · edp1096
Params648M
Context—
Smallest0.5 GB
GGUF
NE
nemotron 3.5 asr streaming 0.6b q6k
Nemotron · Bharath0209
Params638M
Context—
Smallest0.6 GB
GGUF
NE
Nemotron Speech Streaming EN
Nemotron · vocabulary11
Params618M
Context—
Smallest0.7 GB
GGUF
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · WorkOffline
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
Nemotron 3.5 Bolt GameDev
Nemotron · dsfrdgttrtrshr
Params7.52B
Context64K
Smallest0.0 GB
GGUF
NE
nvidia.OpenCodeReasoning Nemotron 32B
Nemotron · DevQuasar
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Nemotron · inference-snaps
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
Nemotron H 4B Instruct
Nemotron · sillykiwi
Params4.49B
Context1024K
Smallest3.7 GB
GGUF

Keep browsing