Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
.nemotron-3.5-asr-streaming-0.6b.q8_0.gguf
Nemotron · onemira
Params648M
Context—
Smallest0.7 GB
NE
Nemotron 3 Nano Omni 30B A3B Reasoning FP8 5GB
Nemotron · inference-snaps
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
mythograph nemotron 3 nano 4b
Nemotron · kasimakpinar
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
nemotron h 4b base
Nemotron · darthceltic85
Params4.49B
Context1024K
Smallest4.8 GB
NE
Nemotron Labs Diffusion 14B Q6 K
Nemotron · JZC973
Params13.5B
Context256K
Smallest11.4 GB
NE
Openbuddy Nemotron 70b V23.2Q 131k
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
OpenCodeReasoning Nemotron 1.1 32B Q4 K M
Nemotron · danijo13
Params32.8B
Context64K
Q4_K_M19.9 GB
NE
OpenCodeReasoning Nemotron 1.1 14B Q5 K S
Nemotron · NikolayKozloff
Params14.8B
Context64K
Smallest10.3 GB
NE
Nemotron 3 Super 120B A12B RotorQuant GGUF Q6 K
Nemotron · majentik
Params121B
Context1024K
Smallest112.9 GB
NE
Nemotron 3 Nano REAP 21B A3B MXFP4
Nemotron · QuietImpostor
Params20.6B
Context1024K
Smallest12.1 GB
NE
Nemotron-3-Nano-30B-A3B
Nemotron · llmware
Params31.6B
Context1024K
Smallest18.2 GB
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · Arsh9210
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
Gym Buddy Nemotron 4b GGUF Merged
Nemotron · PedroRuizCode
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
Nvidia AceReason Nemotron 14B
Nemotron · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
NE
Nemotron 3 Diarization
Nemotron · gpillon
Params99M
Context—
Smallest0.2 GB
NE
AceReason Nemotron 14B
Nemotron · akpsahan
Params14.8B
Context128K
Smallest7.9 GB
NE
Nemotron 3 Nano 4B HIPE po geta
Nemotron · andersonscode
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
OpenMath Nemotron 1.5B GRPO NuminaMath 10K
Nemotron · ermiaazarkhalili
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · NikolayKozloff
Params12.3B
Context1024K
Smallest10.1 GB
NE
Nemotron Cascade 2 96E
Nemotron · blascotobasco
Params24.2B
Context1024K
Q4_K_M18.8 GB
NE
OpenMath Nemotron 1.5B
Nemotron · devisri050
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
CityQuest Nemotron 3 Nano 4B
Nemotron · NANI-Nithin
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
Nemotron 3 Super Q4 K M YaRN 1M
Nemotron · mixbits
Params124B
Context1024K
Q4_K_M86.8 GB
NE
Nemotron 15b Thinker v0.1
Nemotron · Nitrals-Quants
Params15B
Context64K
Q4_K_M9.1 GB
NE
fabletron nemotron 3 super 120b
Nemotron · greghavens
Params121B
Context1024K
Q4_K_M86.1 GB
NE
Nemotron 3 Super 120B A12B TurboQuant GGUF Q5 K M
Nemotron · majentik
Params121B
Context1024K
Smallest95.7 GB
NE
Nemotron Orchestrator 8B
Nemotron · dark-pen
Params8.19B
Context40K
Smallest4.6 GB
NE
Nemotron 3 Nano 30B A3B RotorQuant GGUF Q2 K
Nemotron · majentik
Params31.6B
Context1024K
Smallest17.9 GB
NE
Nemotron 3 Nano 4B RotorQuant GGUF Q2 K
Nemotron · majentik
Params3.97B
Context1024K
Smallest2.2 GB
NE
Nemotron Mini 4B Instruct Q4 K M
Nemotron · jairo
Params4.19B
Context4K
Q4_K_M2.7 GB