Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron W 4b MagLight 0.1
Nemotron · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
NE
Nemotron Mini 4B Instruct Q4 K M
Nemotron · WSDW
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
Nemotron3 Nano 4B Aggressive
Nemotron · nazihara
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
Nemotron W 4b Halo 0.1 i1
Nemotron · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
NE
Nemotron 3 Nano 4B HIPE step fast
Nemotron · andersonscode
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Smallest8.8 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · AXONVERTEX-AI-RESEARCH
Params8.89B
Context1024K
Smallest9.5 GB
ReasoningTool use
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · dictaclick
Params638M
Context—
Smallest0.8 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · inferenceport-ai
Params31.6B
Context1024K
Smallest24.5 GB
GGUF
NE
Nemotron 3 Super 120B A12B TurboQuant GGUF Q8 0
Nemotron · majentik
Params121B
Context1024K
Smallest128.5 GB
GGUF
NE
Nemotron Cc Polish Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
NVIDIA-Nemotron-3-Super-120B-A12B-BF16
Nemotron · ddh0
Params121B
Context1024K
Smallest101.7 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B Q4 0
Nemotron · znormn
Params32.9B
Context1024K
Smallest18.7 GB
ReasoningTool use
NE
Nemotron Dpo
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
AceReason Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
CodingReasoningTool use
NE
NVIDIA Nemotron 3 Nano 30B A3B BF16
Nemotron · lm-kit
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Nemotron Cascade 2 30B A3B RotorQuant GGUF Q8 0
Nemotron · majentik
Params31.6B
Context1024K
Smallest33.6 GB
ReasoningTool use
NE
voicebar nemotron 3.5 asr streaming 0.6b
Nemotron · elamus
Params638M
Context—
Smallest0.8 GB
GGUF
NE
Nemotron Speech Streaming EN
Nemotron · voicetide
Params618M
Context—
Smallest0.7 GB
GGUF
NE
Elbaz NVIDIA Nemotron 3 Nano 30B A3B PRISM Q5 K M
Nemotron · icefog72
Params31.6B
Context1024K
Smallest26.0 GB
CodingReasoningTool use
NE
Nemotron Nano 3 30B A3B Q4 K M 5GB
Nemotron · inference-snaps
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Q4_K_M7.5 GB
ReasoningTool use
NE
Nemotron 3 Nano 30B A3B RotorQuant GGUF Q5 K M
Nemotron · majentik
Params31.6B
Context1024K
Smallest26.0 GB
ReasoningTool use
NE
OpenCodeReasoning Nemotron 1.1 7B Q4 K M
Nemotron · n00b001
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · SandLogicTechnologies
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
Nemotron Mini 4B Instruct GGUF Q8
Nemotron · abiks
Params4.19B
Context4K
Smallest4.5 GB
Tool use
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Smallest8.6 GB
ReasoningTool use
NE
Openbuddy Nemotron 70b v23.2 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
Nemotron-Labs-Diffusion-VLM-8B
Nemotron · IntellAgents
Params8.49B
Context256K
Smallest17.0 GB
ReasoningTool use
NE
Nemotron Mini 4B Instruct IQ4 XS
Nemotron · performanceoptician
Params4.19B
Context4K
Smallest2.5 GB
Tool use

Keep browsing