Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
NVIDIA Nemotron 3 Super 120B A12B BF16
Nemotron · Iambackup
Params121B
Context1024K
Smallest112.9 GB
ReasoningTool use
NE
Nemotron Labs GGUF checkpoints
Nemotron · IntellAgents
Params3.83B
Context256K
Smallest4.1 GB
ReasoningTool use
NE
Nemotron 3 Nano 4B RotorQuant GGUF Q2 K
Nemotron · VAREQON
Params3.97B
Context1024K
Smallest2.2 GB
ReasoningTool use
NE
Nemotron3 Nano 4B Uncensored HauhauCS Aggressive GenRM
Nemotron · justfrfn
Params3.97B
Context1024K
Smallest2.2 GB
ReasoningTool use
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · mailroomdevelopers-del
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
Nemotron Cascade 8B Thinking
Nemotron · NikolayKozloff
Params8.19B
Context32K
Smallest8.7 GB
ReasoningTool use
NE
OpenReasoning Nemotron 7B
Nemotron · sandner
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
NE
nemotron vulnerability remediation q4
Nemotron · NilHRH
Params31.6B
Context1024K
Q4_K_M24.3 GB
ReasoningTool use
NE
noir verdict nemotron 4b
Nemotron · sankalphs
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
AceReason Nemotron 1.1 7B
Nemotron · bndp
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
Nemotron Cascade 14B Thinking
Nemotron · NikolayKozloff
Params14.8B
Context32K
Smallest10.3 GB
ReasoningTool use
NE
Orchestrator 8B
Nemotron · jmelahman
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
4b-nemotron
Nemotron · Ba2han
Params4.51B
Context128K
Smallest3.7 GB
GGUF
NE
Agent Nemotron ROCmFP6
Nemotron · cafonez
Params31.6B
Context1024K
Smallest29.3 GB
ReasoningTool use
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
CodingReasoning
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · shrikanthzededa
Params8.89B
Context1024K
Smallest5.0 GB
ReasoningTool use
NE
Openhands Nemotron 32B Karcher
Nemotron · win10
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
NE
AceReason Nemotron 1.1 7B
Nemotron · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
CodingReasoningTool use
NE
OpenReasoning Nemotron 1.5B
Nemotron · sandner
Params1.54B
Context128K
Smallest1.3 GB
CodingReasoning
NE
Nvidia AceMath RL Nemotron 7B
Nemotron · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
ReasoningTool use
NE
Nemotron 3 Nano 30B A3B
Nemotron · forkjoin-ai
Params31.6B
Context1024K
Q4_K_M24.7 GB
ReasoningTool use
NE
plane mode study coach lora
Nemotron · GuusBouwensNL
Params10M
Context—
Smallest0.0 GB
GGUF
NE
L3.1 nemotron sunfall v0.7.0 q4 k m
Nemotron · crestf411
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoning
NE
Orchestrator 8B
Nemotron · gannima
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
Nemotron Cascade 14B Thinking
Nemotron · NikolayKozloff
Params14.8B
Context32K
Smallest8.6 GB
ReasoningTool use
NE
OpenReasoning Nemotron 14B
Nemotron · sm54
Params14.8B
Context128K
Smallest12.1 GB
CodingReasoning
NE
speech models
Nemotron · Parafoil
Params99M
Context—
Smallest0.1 GB
GGUF
NE
nemotron 3.5 asr streaming 0.6b tmp
Nemotron · rleary
Params648M
Context—
Smallest0.7 GB
GGUF
NE
Nemotron Q4 KS Single
Nemotron · Toramannnn
Params341B
Context4K
Smallest195.1 GB
GGUF

Keep browsing