Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
OpenMath-Nemotron-1.5B-PruneAware-2
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
NE
Nemotron 3 Nano 30B A3B Nexus Agents
Nemotron · NexusProjectsAI
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · ijohn07
Params31.6B
Context1024K
Smallest33.5 GB
GGUF
NE
Nvidia-Nemotron-3-Super-120B-A12B
Nemotron · cPilotGod
Params121B
Context1024K
Q4_K_M82.5 GB
ReasoningTool use
NE
Apriel Nemotron 15b Thinker i
Nemotron · ilintar
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
NE
Openbuddy Nemotron 70b V23.2Q 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
NVIDIA Nemotron 3 Nano 30B A3B BF16
Nemotron · Xylolabs
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Rombos LLM V2.6 Nemotron 70b
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
NE
Fritter Nemotron 0.6B
Nemotron · Fritter-ASR
Params618M
Context—
Smallest1.2 GB
GGUF
NE
Nemotron 3 Nano Omni 30B A3B Reasoning TurboQuant GGUF IQ4 XS
Nemotron · majentik
Params31.6B
Context1024K
Smallest18.2 GB
ReasoningTool useVision
NE
Nemotron Cascade 2 30B A3B TurboQuant GGUF IQ4 XS
Nemotron · majentik
Params31.6B
Context1024K
Smallest18.2 GB
ReasoningTool use
NE
Nvidia NVIDIA Nemotron 3 Nano 30B A3B BF16
Nemotron · batiai
Params31.6B
Context1024K
Smallest17.9 GB
ReasoningTool use
NE
decisive dory
Nemotron · rdaum
Params3.98B
Context256K
Smallest4.2 GB
CodingReasoningTool use
NE
NVIDIA Nemotron Labs 3 Elastic 30B A3B NVFP4
Nemotron · DemomanCA
Params12.4B
Context1024K
Smallest8.1 GB
ReasoningTool use
NE
Nemotron 3.5 Lightning 30B A3B REAP 20B LoRA IQ4NL
Nemotron · sleepyeldrazi
Params19.9B
Context1024K
Smallest11.5 GB
ReasoningTool use
NE
Nemotron 3 Nano Omni 30B A3B Reasoning RotorQuant GGUF Q2 K
Nemotron · majentik
Params31.6B
Context1024K
Smallest17.9 GB
ReasoningTool useVision
NE
Nemotron Cc Italian Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
NVIDIA Nemotron Labs 3 Elastic 12B A2B
Nemotron · nightmedia
Params12.4B
Context1024K
Q4_K_M9.6 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · ijohn07
Params31.6B
Context1024K
Smallest33.6 GB
GGUF
NE
Gary Nemotron 30b v7.3 Merged
Nemotron · SMOK33Y3
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
nemotron 3 nano 4b
Nemotron · lm-kit
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · ijohn07
Params31.6B
Context1024K
Smallest17.9 GB
GGUF
NE
Nemotron-3 Diarization
Nemotron · dawsonvosburg
Params99M
Context—
Smallest0.1 GB
GGUF
NE
blackout buddy nemotron lora
Nemotron · mitvho09
Params83M
Context—
Smallest0.0 GB
GGUF
NE
addis scribe streaming
Nemotron · buctl
Params634M
Context—
Smallest0.7 GB
GGUF
NE
Nemotron 3 Nano Omni 30B A3B Reasoning
Nemotron · Hob-forge
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
nemotron 3.5 asr streaming 0.6b loom
Nemotron · loom-ai-org
Params638M
Context—
Smallest2.6 GB
GGUF
NE
Gary Nemotron 30b v8 Merged
Nemotron · SMOK33Y3
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Huihui ai.AceReason Nemotron 14B Abliterated
Nemotron · DevQuasar
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
NE
nemotron 3.5 bolt e4b topo governed fineweb
Nemotron · frankmorales2020
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool use

Keep browsing