Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B DSpark
Nemotron · meshllm
Params968M
Context1024K
Smallest1.0 GB
NE
OpenMath Nemotron 1.5B
Nemotron · lmstudio-community
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · memoravox
Params638M
Context—
Smallest0.8 GB
NE
nvidia_NVIDIA Nemotron 3 Nano 30B A3B FP8_local
Nemotron · modelfix
Params31.6B
Context1024K
Smallest24.5 GB
NE
Nemotron 3 Nano Omni 30B A3B Reasoning TurboQuant GGUF Q5 K M
Nemotron · majentik
Params31.6B
Context1024K
Smallest26.0 GB
NE
nemotron 3.5 asr ptbr
Nemotron · marcosremar2
Params648M
Context—
Smallest0.8 GB
NE
gguf Q5 K M Nemotron Mini 4B Instruct
Nemotron · Felladrin
Params4.19B
Context4K
Smallest6.1 GB
NE
nvidia.AceReason Nemotron 7B
Nemotron · DevQuasar
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Nvidia-Nemotron-3-Super-120B-A12B
Nemotron · meshllm
Params124B
Context1024K
Smallest89.7 GB
NE
Nemotron Cc Swe Opus
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
Nemotron Cc French Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
Nemotron 15b Thinker Instruct
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
NE
Q4 0 nemotron 3.5 asr streaming 0.6b
Nemotron · framadhita
Params638M
Context—
Smallest0.6 GB
NE
Nemotron Orchestrator 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
NE
OpenThai 2.0 Legal ThaiLLM Nemotron 3 Nano 30B A3B IQ4 NL
Nemotron · Naypa
Params31.6B
Context1024K
Smallest18.2 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · Doctoc-Health
Params638M
Context—
Smallest0.8 GB
NE
Nemotron-Labs-Diffusion-VLM-8B
Nemotron · IntellAgents
Params8.49B
Context256K
Smallest17.0 GB
NE
Nemotron Content Safety Reasoning 4B
Nemotron · ARM174G3
Params4.55B
Context128K
Smallest4.8 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · willspeak
Params638M
Context—
Smallest0.6 GB
NE
Nemotron Content Safety Reasoning 4B
Nemotron · AXONVERTEX-AI-RESEARCH
Params4.55B
Context128K
Smallest4.8 GB
NE
Nemotron3 Nano 4B Uncensored HauhauCS Aggressive GenRM
Nemotron · Unrestricted
Params3.97B
Context1024K
Smallest2.2 GB
NE
Advisor
Nemotron · Orionfold
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
nemotron-3.5-asr-streaming-0.6b.q5_k
Nemotron · edp1096
Params648M
Context—
Smallest0.5 GB
NE
nemotron 3.5 asr streaming 0.6b q6k
Nemotron · Bharath0209
Params638M
Context—
Smallest0.6 GB
NE
Nemotron Speech Streaming EN
Nemotron · vocabulary11
Params618M
Context—
Smallest0.7 GB
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · WorkOffline
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
Nemotron 3.5 Bolt GameDev
Nemotron · dsfrdgttrtrshr
Params7.52B
Context64K
Smallest0.0 GB
NE
nvidia.OpenCodeReasoning Nemotron 32B
Nemotron · DevQuasar
Params32.8B
Context32K
Q4_K_M19.9 GB
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Nemotron · inference-snaps
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
Nemotron H 4B Instruct
Nemotron · sillykiwi
Params4.49B
Context1024K
Smallest3.7 GB