Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
Nemotron W 4b MagLight 0.1
Nemotron · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
NE
Nemotron Mini 4B Instruct Q4 K M
Nemotron · WSDW
Params4.19B
Context4K
Q4_K_M2.7 GB
NE
Nemotron3 Nano 4B Aggressive
Nemotron · nazihara
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
Nemotron W 4b Halo 0.1 i1
Nemotron · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
NE
Nemotron 3 Nano 4B HIPE step fast
Nemotron · andersonscode
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Smallest8.8 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · AXONVERTEX-AI-RESEARCH
Params8.89B
Context1024K
Smallest9.5 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · dictaclick
Params638M
Context—
Smallest0.8 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · inferenceport-ai
Params31.6B
Context1024K
Smallest24.5 GB
NE
Nemotron 3 Super 120B A12B TurboQuant GGUF Q8 0
Nemotron · majentik
Params121B
Context1024K
Smallest128.5 GB
NE
Nemotron Cc Polish Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
NVIDIA-Nemotron-3-Super-120B-A12B-BF16
Nemotron · ddh0
Params121B
Context1024K
Smallest101.7 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B Q4 0
Nemotron · znormn
Params32.9B
Context1024K
Smallest18.7 GB
NE
Nemotron Dpo
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
AceReason Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
NE
NVIDIA Nemotron 3 Nano 30B A3B BF16
Nemotron · lm-kit
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
Nemotron Cascade 2 30B A3B RotorQuant GGUF Q8 0
Nemotron · majentik
Params31.6B
Context1024K
Smallest33.6 GB
NE
voicebar nemotron 3.5 asr streaming 0.6b
Nemotron · elamus
Params638M
Context—
Smallest0.8 GB
NE
Nemotron Speech Streaming EN
Nemotron · voicetide
Params618M
Context—
Smallest0.7 GB
NE
Elbaz NVIDIA Nemotron 3 Nano 30B A3B PRISM Q5 K M
Nemotron · icefog72
Params31.6B
Context1024K
Smallest26.0 GB
NE
Nemotron Nano 3 30B A3B Q4 K M 5GB
Nemotron · inference-snaps
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Q4_K_M7.5 GB
NE
Nemotron 3 Nano 30B A3B RotorQuant GGUF Q5 K M
Nemotron · majentik
Params31.6B
Context1024K
Smallest26.0 GB
NE
OpenCodeReasoning Nemotron 1.1 7B Q4 K M
Nemotron · n00b001
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · SandLogicTechnologies
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
Nemotron Mini 4B Instruct GGUF Q8
Nemotron · abiks
Params4.19B
Context4K
Smallest4.5 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Smallest8.6 GB
NE
Openbuddy Nemotron 70b v23.2 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Nemotron-Labs-Diffusion-VLM-8B
Nemotron · IntellAgents
Params8.49B
Context256K
Smallest17.0 GB
NE
Nemotron Mini 4B Instruct IQ4 XS
Nemotron · performanceoptician
Params4.19B
Context4K
Smallest2.5 GB