Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
nvidia.NVIDIA Nemotron 3 Nano 30B A3B Base BF16
Nemotron · DevQuasar
Params31.6B
Context1024K
Smallest17.9 GB
GGUF
NE
nemotron labs unified asr 0.6b loom
Nemotron · loom-ai-org
Params637M
Context—
Smallest0.7 GB
GGUF
NE
Nemotron Cc French Opus
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
NVIDIA Nemotron 3 Ultra 550B A55B BF16
Nemotron · AesSedai
Params549B
Context1024K
Smallest0.7 GB
GGUF
NE
nvidia.OpenCodeReasoning Nemotron 7B
Nemotron · DevQuasar
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
Nemotron 3 Super 120B A12B MINT
Nemotron · baa-ai
Params121B
Context1024K
Q4_K_M86.1 GB
ReasoningTool use
NE
Nemotron 3 Diarization
Nemotron · mudler
Params99M
Context—
Smallest0.1 GB
GGUF
NE
OpenReasoning Nemotron 32B
Nemotron · DevQuasar
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
NE
nvidia.NVIDIA Nemotron 3 Nano 30B A3B BF16
Nemotron · DevQuasar
Params31.6B
Context1024K
Smallest17.9 GB
ReasoningTool use
NE
Nvidia AceReason Nemotron 7B
Nemotron · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
CodingReasoningTool use
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · GGUF-A-Lot
Params12.3B
Context1024K
Q4_K_M8.3 GB
ReasoningTool use
NE
Apriel Nemotron 15b Thinker
Nemotron · redponike
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
NE
Nero Tron 30B
Nemotron · Caliane
Params31.6B
Context1024K
Q4_K_M24.5 GB
CodingReasoningTool use
NE
NVIDIA Nemotron 3 Nano 30B A3B
Nemotron · xCloudinfo
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Openbuddy Nemotron 70b v23.2 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
Nemotron Cc Norwegian Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
Openhands Nemotron 32B Karcher
Nemotron · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
NE
Openbuddy Nemotron 70b v23.1 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
warden nemotron 3 nano 30b
Nemotron · IMJONEZZ
Params31.6B
Context1024K
Smallest17.9 GB
ReasoningRoleplayTool use
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · JoaoZaokk
Params638M
Context—
Smallest0.7 GB
GGUF
NE
nvidia nemotron 3.5 lightning 30b
Nemotron · aj9o9
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
Nemotron3.3 i1
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
Nemotron Cascade 2 30B A3B
Nemotron · noctrex
Params31.6B
Context1024K
Smallest20.0 GB
ReasoningTool use
NE
NVIDIA Nemotron Labs 3 Elastic 23B A2.8B
Nemotron · HackerTwins
Params23.6B
Context1024K
Q4_K_M16.7 GB
ReasoningTool use
NE
Nemotron 3 Super 120B A12B GGUF Claude 4.6 Opus Reasoning Distilled
Nemotron · blobbybob
Params121B
Context1024K
Smallest86.1 GB
ReasoningTool use
NE
4b-nemotron
Nemotron · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
Tool use
NE
AceReason Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NE
OpenBuddy/openbuddy-nemotron-70b-v23.1-131k
Nemotron · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B DFlash
Nemotron · meshllm
Params833M
Context1024K
Smallest0.9 GB
GGUF
NE
Nemotron3-Nano-4B-Uncensored-HauhauCS-Aggressive
Nemotron · justfrfn
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use

Keep browsing