Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
OpenMath-Nemotron-1.5B-PruneAware-2
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
Nemotron 3 Nano 30B A3B Nexus Agents
Nemotron · NexusProjectsAI
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · ijohn07
Params31.6B
Context1024K
Smallest33.5 GB
NE
Nvidia-Nemotron-3-Super-120B-A12B
Nemotron · cPilotGod
Params121B
Context1024K
Q4_K_M82.5 GB
NE
Apriel Nemotron 15b Thinker i
Nemotron · ilintar
Params15B
Context64K
Q4_K_M9.1 GB
NE
Openbuddy Nemotron 70b V23.2Q 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
NVIDIA Nemotron 3 Nano 30B A3B BF16
Nemotron · Xylolabs
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
Rombos LLM V2.6 Nemotron 70b
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Fritter Nemotron 0.6B
Nemotron · Fritter-ASR
Params618M
Context—
Smallest1.2 GB
NE
Nemotron 3 Nano Omni 30B A3B Reasoning TurboQuant GGUF IQ4 XS
Nemotron · majentik
Params31.6B
Context1024K
Smallest18.2 GB
NE
Nemotron Cascade 2 30B A3B TurboQuant GGUF IQ4 XS
Nemotron · majentik
Params31.6B
Context1024K
Smallest18.2 GB
NE
Nvidia NVIDIA Nemotron 3 Nano 30B A3B BF16
Nemotron · batiai
Params31.6B
Context1024K
Smallest17.9 GB
NE
decisive dory
Nemotron · rdaum
Params3.98B
Context256K
Smallest4.2 GB
NE
NVIDIA Nemotron Labs 3 Elastic 30B A3B NVFP4
Nemotron · DemomanCA
Params12.4B
Context1024K
Smallest8.1 GB
NE
Nemotron 3.5 Lightning 30B A3B REAP 20B LoRA IQ4NL
Nemotron · sleepyeldrazi
Params19.9B
Context1024K
Smallest11.5 GB
NE
Nemotron 3 Nano Omni 30B A3B Reasoning RotorQuant GGUF Q2 K
Nemotron · majentik
Params31.6B
Context1024K
Smallest17.9 GB
NE
Nemotron Cc Italian Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
NVIDIA Nemotron Labs 3 Elastic 12B A2B
Nemotron · nightmedia
Params12.4B
Context1024K
Q4_K_M9.6 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · ijohn07
Params31.6B
Context1024K
Smallest33.6 GB
NE
Gary Nemotron 30b v7.3 Merged
Nemotron · SMOK33Y3
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
nemotron 3 nano 4b
Nemotron · lm-kit
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
Nemotron · ijohn07
Params31.6B
Context1024K
Smallest17.9 GB
NE
Nemotron-3 Diarization
Nemotron · dawsonvosburg
Params99M
Context—
Smallest0.1 GB
NE
blackout buddy nemotron lora
Nemotron · mitvho09
Params83M
Context—
Smallest0.0 GB
NE
addis scribe streaming
Nemotron · buctl
Params634M
Context—
Smallest0.7 GB
NE
Nemotron 3 Nano Omni 30B A3B Reasoning
Nemotron · Hob-forge
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
nemotron 3.5 asr streaming 0.6b loom
Nemotron · loom-ai-org
Params638M
Context—
Smallest2.6 GB
NE
Gary Nemotron 30b v8 Merged
Nemotron · SMOK33Y3
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
Huihui ai.AceReason Nemotron 14B Abliterated
Nemotron · DevQuasar
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
nemotron 3.5 bolt e4b topo governed fineweb
Nemotron · frankmorales2020
Params7.52B
Context64K
Q4_K_M5.3 GB