Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron Mini 4B Instruct imatrix
Nemotron · duyntnet
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B LiLiCorr
Nemotron · lmstudio-community
Params1.11B
Context256K
Smallest1.0 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Transcribe 30B A4B BF16
Nemotron · AMAImedia
Params32.9B
Context1024K
Smallest1.7 GB
GGUF
NE
Nemotron 3.5 Bolt E4B NVFP4
Nemotron · WhiskyAKM
Params7.52B
Context64K
Smallest4.3 GB
ReasoningTool useVision
NE
nvidia.Nemotron Terminal 8B
Nemotron · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
IQ2 NL IQ3 NL Test Models
Nemotron · eaddario
Params8.89B
Context1024K
Smallest0.0 GB
GGUF
NE
NVIDIA Nemotron Labs 3 Puzzle 75B A9B
Nemotron · RemySkye
Params78.3B
Context1024K
Q4_K_M51.6 GB
ReasoningTool use
NE
OpenMath Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
Nemotron SEA LION v4.8 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
Gary Nemotron 8b v2 Merged
Nemotron · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
NE
KO VoicePersona E4B
Nemotron · ThakiCloud
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool useVision
NE
nvidia OpenCodeReasoning Nemotron 32B
Nemotron · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
L3.1 nemotron sunfall v0.7.0 i1
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · second-state
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
Nemotron Cascade 2 30B A3B Heretic Ara Uncensored
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Heretic Nemotron Content Safety Reasoning 4B
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
NE
NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · QuantFactory
Params9B
Context—
Q4_K_M5.5 GB
GGUF
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4
Nemotron · FedericoFB
Params124B
Context1024K
Smallest78.7 GB
ReasoningTool useVision
NE
GaMS 27B Instruct Nemotron
Nemotron · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
NE
JustRL Nemotron 1.5B
Nemotron · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
NE
AceReason Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
NE
OpenCodeReasoning Nemotron 1.1 14B i1
Nemotron · mradermacher
Params14.8B
Context64K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
NVIDIA-Nemotron-Nano-12B-v2
Nemotron · Mungert
Params12.3B
Context1024K
Q4_K_M7.9 GB
ReasoningTool use
NE
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
Nemotron · Myric
Params121B
Context1024K
Smallest81.0 GB
ReasoningTool useVision
NE
Nemotron Cascade 14B Thinking Claude 4.5 Opus High Reasoning Distill
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
NE
Nemotron SEA LION v4.8 30B A3B
Nemotron · aisingapore
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
Nemotron 3 8b Chat 4k Sft Hf
Nemotron · mradermacher
Params8.54B
Context4K
Q4_K_M5.4 GB
GGUF
NE
Orchestrator 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
Nemotron Orchestrator 8B Claude 4.5 Opus Distill
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use

Keep browsing