Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
.nemotron-3.5-asr-streaming-0.6b.q8_0.gguf
Nemotron · onemira
Params648M
Context—
Smallest0.7 GB
GGUF
NE
Nemotron 3 Nano Omni 30B A3B Reasoning FP8 5GB
Nemotron · inference-snaps
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool useVision
NE
mythograph nemotron 3 nano 4b
Nemotron · kasimakpinar
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
nemotron h 4b base
Nemotron · darthceltic85
Params4.49B
Context1024K
Smallest4.8 GB
GGUF
NE
Nemotron Labs Diffusion 14B Q6 K
Nemotron · JZC973
Params13.5B
Context256K
Smallest11.4 GB
ReasoningTool use
NE
Openbuddy Nemotron 70b V23.2Q 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
OpenCodeReasoning Nemotron 1.1 32B Q4 K M
Nemotron · danijo13
Params32.8B
Context64K
Q4_K_M19.9 GB
CodingReasoningTool use
NE
OpenCodeReasoning Nemotron 1.1 14B Q5 K S
Nemotron · NikolayKozloff
Params14.8B
Context64K
Smallest10.3 GB
CodingReasoningTool use
NE
Nemotron 3 Super 120B A12B RotorQuant GGUF Q6 K
Nemotron · majentik
Params121B
Context1024K
Smallest112.9 GB
GGUF
NE
Nemotron 3 Nano REAP 21B A3B MXFP4
Nemotron · QuietImpostor
Params20.6B
Context1024K
Smallest12.1 GB
ReasoningTool use
NE
Nemotron-3-Nano-30B-A3B
Nemotron · llmware
Params31.6B
Context1024K
Smallest18.2 GB
CodingReasoningTool use
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · Arsh9210
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
Gym Buddy Nemotron 4b GGUF Merged
Nemotron · PedroRuizCode
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
Nvidia AceReason Nemotron 14B
Nemotron · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
CodingReasoningTool use
NE
Nemotron 3 Diarization
Nemotron · gpillon
Params99M
Context—
Smallest0.2 GB
GGUF
NE
AceReason Nemotron 14B
Nemotron · akpsahan
Params14.8B
Context128K
Smallest7.9 GB
CodingReasoningTool use
NE
Nemotron 3 Nano 4B HIPE po geta
Nemotron · andersonscode
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
OpenMath Nemotron 1.5B GRPO NuminaMath 10K
Nemotron · ermiaazarkhalili
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Smallest10.1 GB
ReasoningTool use
NE
Nemotron Cascade 2 96E
Nemotron · blascotobasco
Params24.2B
Context1024K
Q4_K_M18.8 GB
ReasoningTool use
NE
OpenMath Nemotron 1.5B
Nemotron · devisri050
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
NE
CityQuest Nemotron 3 Nano 4B
Nemotron · NANI-Nithin
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
Nemotron 3 Super Q4 K M YaRN 1M
Nemotron · mixbits
Params124B
Context1024K
Q4_K_M86.8 GB
GGUF
NE
Nemotron 15b Thinker v0.1
Nemotron · Nitrals-Quants
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
NE
fabletron nemotron 3 super 120b
Nemotron · greghavens
Params121B
Context1024K
Q4_K_M86.1 GB
ReasoningTool use
NE
Nemotron 3 Super 120B A12B TurboQuant GGUF Q5 K M
Nemotron · majentik
Params121B
Context1024K
Smallest95.7 GB
GGUF
NE
Nemotron Orchestrator 8B
Nemotron · dark-pen
Params8.19B
Context40K
Smallest4.6 GB
ReasoningTool use
NE
Nemotron 3 Nano 30B A3B RotorQuant GGUF Q2 K
Nemotron · majentik
Params31.6B
Context1024K
Smallest17.9 GB
ReasoningTool use
NE
Nemotron 3 Nano 4B RotorQuant GGUF Q2 K
Nemotron · majentik
Params3.97B
Context1024K
Smallest2.2 GB
ReasoningTool use
NE
Nemotron Mini 4B Instruct Q4 K M
Nemotron · jairo
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use

Keep browsing