Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
Nemotron Mini 4B Instruct imatrix
Nemotron · duyntnet
Params4.19B
Context4K
Q4_K_M2.7 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B LiLiCorr
Nemotron · lmstudio-community
Params1.11B
Context256K
Smallest1.0 GB
NE
NVIDIA Nemotron 3.5 Transcribe 30B A4B BF16
Nemotron · AMAImedia
Params32.9B
Context1024K
Smallest1.7 GB
NE
Nemotron 3.5 Bolt E4B NVFP4
Nemotron · WhiskyAKM
Params7.52B
Context64K
Smallest4.3 GB
NE
nvidia.Nemotron Terminal 8B
Nemotron · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
NE
IQ2 NL IQ3 NL Test Models
Nemotron · eaddario
Params8.89B
Context1024K
Smallest0.0 GB
NE
NVIDIA Nemotron Labs 3 Puzzle 75B A9B
Nemotron · RemySkye
Params78.3B
Context1024K
Q4_K_M51.6 GB
NE
OpenMath Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
Nemotron SEA LION v4.8 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
Gary Nemotron 8b v2 Merged
Nemotron · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
KO VoicePersona E4B
Nemotron · ThakiCloud
Params7.52B
Context64K
Q4_K_M5.3 GB
NE
nvidia OpenCodeReasoning Nemotron 32B
Nemotron · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
NE
L3.1 nemotron sunfall v0.7.0 i1
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · second-state
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
Nemotron Cascade 2 30B A3B Heretic Ara Uncensored
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
Heretic Nemotron Content Safety Reasoning 4B
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
NE
NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · QuantFactory
Params9B
Context—
Q4_K_M5.5 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4
Nemotron · FedericoFB
Params124B
Context1024K
Smallest78.7 GB
NE
GaMS 27B Instruct Nemotron
Nemotron · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
NE
JustRL Nemotron 1.5B
Nemotron · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
NE
AceReason Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
OpenCodeReasoning Nemotron 1.1 14B i1
Nemotron · mradermacher
Params14.8B
Context64K
Q4_K_M9.0 GB
NE
NVIDIA-Nemotron-Nano-12B-v2
Nemotron · Mungert
Params12.3B
Context1024K
Q4_K_M7.9 GB
NE
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
Nemotron · Myric
Params121B
Context1024K
Smallest81.0 GB
NE
Nemotron Cascade 14B Thinking Claude 4.5 Opus High Reasoning Distill
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
Nemotron SEA LION v4.8 30B A3B
Nemotron · aisingapore
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
Nemotron 3 8b Chat 4k Sft Hf
Nemotron · mradermacher
Params8.54B
Context4K
Q4_K_M5.4 GB
NE
Orchestrator 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
NE
Nemotron Orchestrator 8B Claude 4.5 Opus Distill
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB