Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron Cc Swedish Tower72B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
OpenMath Nemotron 14B
Nemotron · lmstudio-community
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
NE
Nemotron 3 Super 120B A12B MTP
Nemotron · AlexCaswen
Params4.02B
Context1024K
Smallest8.0 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · GGUF-A-Lot
Params8.89B
Context1024K
Q4_K_M7.1 GB
ReasoningTool use
NE
bibo asr nemotron
Nemotron · fhai50032
Params618M
Context—
Smallest0.7 GB
GGUF
NE
Nemotron3.3
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
Nemotron Cc Cat Opus
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
Nemotron Cc German 9b
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
NVIDIA-Nemotron-3-Ultra-550B-A55B
Nemotron · vultr
Params549B
Context1024K
Q4_K_M379.6 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B LiLiCorr
Nemotron · meshllm
Params1.11B
Context256K
Smallest1.2 GB
ReasoningTool use
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · 1bit-MONSTER
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
NVIDIA Nemotron3 Nano 4B Q4 K M
Nemotron · aoiandroid
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · kusema
Params638M
Context—
Smallest0.8 GB
GGUF
NE
Nemotron 3 Diarization AIPod HF
Nemotron · manateelazycat
Params99M
Context—
Smallest0.1 GB
GGUF
NE
Nemotron 3 Nano 4B TurboQuant GGUF Q4 K M
Nemotron · majentik
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
OpenCodeReasoning Nemotron 1.1 7B
Nemotron · arnabdhar
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
OpenReasoning Nemotron 1.5B
Nemotron · SandLogicTechnologies
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
NE
Nemotron 3.5 Lightning 30B A3B
Nemotron · el4
Params32.9B
Context1024K
Smallest19.3 GB
ReasoningTool use
NE
Nemotron Cc Finnish Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
GGUF
NE
INT8 nemotron 3.5 asr streaming 0.6b
Nemotron · framadhita
Params638M
Context—
Smallest0.6 GB
GGUF
NE
AceReason Nemotron 1.1 Offline GRPO 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
NE
Nemotron 3 Nano 30B A3B
Nemotron · Tinker-Stack
Params31.6B
Context1024K
Smallest18.1 GB
ReasoningTool use
NE
NVIDIA-Nemotron-3-Nano-4B
Nemotron · ddh0
Params3.97B
Context1024K
Smallest3.5 GB
ReasoningTool use
NE
Nemotron-3-Diarization
Nemotron · Bonenk
Params99M
Context—
Smallest0.1 GB
GGUF
NE
Nemotron 3 Nano 4B oss 20b
Nemotron · andersonscode
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
nemotron 3.5 asr 0.6b 325mb
Nemotron · xiaoxiaojian
Params638M
Context—
Smallest0.3 GB
GGUF
NE
NVIDIA Nemotron Nano 12B v2 VL BF16
Nemotron · brunopio
Params12.3B
Context1024K
Smallest7.5 GB
ReasoningTool useVision
NE
Fritter Nemotron 0.6B
Nemotron · danielrosehill
Params618M
Context—
Smallest1.2 GB
GGUF
NE
NemotronLabs AI for Media Sports Tennis GGUF BF16
Nemotron · FedericoFB
Params31.6B
Context1024K
Smallest63.2 GB
ReasoningTool useVision
NE
nemotron speech streaming 0.6B
Nemotron · m1el
Params618M
Context—
Smallest0.4 GB
GGUF

Keep browsing