Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
NVIDIA Nemotron 3 Ultra 550B A55B Base
Nemotron · avar6
Params549B
Context1024K
Smallest277.7 GB
GGUF
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · voicetide
Params638M
Context—
Smallest0.8 GB
GGUF
NE
Nemotron 3 Super 120B A12B TurboQuant GGUF Q3 K M
Nemotron · majentik
Params121B
Context1024K
Smallest67.2 GB
GGUF
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · 0x3
Params638M
Context—
Smallest0.5 GB
GGUF
NE
OpenReasoning Nemotron 7B
Nemotron · SandLogicTechnologies
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
NE
nemotron nano 4b writing style
Nemotron · StratumAnalysisGroup
Params4.51B
Context128K
Q4_K_M2.8 GB
Tool use
NE
AceReason Nemotron 14B
Nemotron · akpsahan
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
Nemotron 3 Nano Omni 30B A3B Reasoning TurboQuant GGUF Q4 K M
Nemotron · majentik
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool useVision
NE
gary nemotron v9
Nemotron · SMOK33Y3
Params31.6B
Context1024K
Smallest26.0 GB
ReasoningTool use
NE
Nemotron 3 Super 120B A12B GGUF HALO
Nemotron · Beinsezii
Params121B
Context1024K
Smallest0.3 GB
GGUF
NE
NVIDIA Nemotron 3 Super 120B A12B Base BF16
Nemotron · avar6
Params121B
Context1024K
Smallest95.7 GB
GGUF
NE
OpenCodeReasoning Nemotron 7B Q4 0
Nemotron · BernTheCreator
Params7.62B
Context32K
Smallest4.4 GB
CodingReasoningTool use
NE
voin nemotron 3.5
Nemotron · tory-labs
Params638M
Context—
Smallest0.8 GB
GGUF
NE
NVIDIA Nemotron Nano 9B v2 Japanese gguf q4 k m
Nemotron · keisuke-miyako
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
nvidia nemotron 3 omni 30b
Nemotron · cPilotGod
Params31.6B
Context1024K
Q4_K_M23.9 GB
ReasoningTool use
NE
Nemotron Cascade 8B
Nemotron · NikolayKozloff
Params8.19B
Context32K
Smallest8.7 GB
ReasoningTool use
NE
Nemotron Cascade 2 30B A3B
Nemotron · shiny-plan
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 12B v2 VL BF16
Nemotron · harishforaiandml
Params12.3B
Context1024K
Smallest4.7 GB
ReasoningTool useVision
NE
Nemotron H 8B Base 8K
Nemotron · thetom-ai
Params8.1B
Context1024K
Smallest5.2 GB
GGUF
NE
Nvidia AceReason Nemotron 1.1 7B
Nemotron · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
CodingReasoningTool use
NE
Nemotron Labs Diffusion 14B Q8 0
Nemotron · spiritbuun
Params13.5B
Context256K
Smallest14.4 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 9B v2 Base
Nemotron · straino
Params8.89B
Context1024K
Q4_K_M6.5 GB
Coding
NE
AceReason Nemotron 1.1 7B
Nemotron · Edge-Quant
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
Nemotron Labs Diffusion 14B Compact APEX
Nemotron · JZC973
Params13.5B
Context256K
Smallest1.4 GB
ReasoningTool use
NE
snapkitty nemotron
Nemotron · Snapkitty
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
nemotron 3 nano 4b
Nemotron · llmware
Params3.97B
Context1024K
Q4_K_M2.8 GB
CodingReasoningTool use
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4 noMTP
Nemotron · SAIFIINDUSTRIES
Params31.6B
Context1024K
Smallest19.8 GB
ReasoningTool use
NE
Nemotron 3 Nano Omni 30B A3B Reasoning TurboQuant GGUF Q8 0
Nemotron · majentik
Params31.6B
Context1024K
Smallest33.6 GB
ReasoningTool useVision
NE
snapkitty harness
Nemotron · Snapkitty
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
Nemotron Cascade 14B Thinking
Nemotron · noctrex
Params14.8B
Context128K
Smallest10.4 GB
ReasoningTool use

Keep browsing