Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
Nemotron Cascade 14B Thinking Impotent Heresy
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
Apriel Nemotron 15b Thinker Magic_decensored_MPOA
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
NE
Nemotron SEA LION v4.8 30B A3B Base
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
NemotronLabs AI for Media Sports Tennis GGUF MXFP4
Nemotron · FedericoFB
Params31.6B
Context1024K
Smallest18.0 GB
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B Abliterated
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
Openbuddy Nemotron 70b V23.2Q 131k
Nemotron · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B IQ4
Nemotron · FP8Enjoyer
Params7.52B
Context64K
Smallest4.0 GB
NE
GaMS 9B Instruct Nemotron
Nemotron · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · cstr
Params638M
Context—
Smallest0.4 GB
NE
openthai2.0 legal thaillm nemotron 3 nano 30b a3b
Nemotron · iapp
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
Nemotron 3.5 Lightning Omni 30B A3B
Nemotron · engram-ae
Params32.9B
Context1024K
Q4_K_M25.4 GB
NE
Nemotron Terminal 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
NE
Ea_Final_Nvidia_Nemotron_3_Super_120B_A12B_Bf16_030326_Vv0.1
Nemotron · ggml-org
Params121B
Context1024K
Smallest69.9 GB
NE
nvidia__NVIDIA Nemotron Nano 9B v2
Nemotron · dominguesm
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
NVIDIA Nemotron Nano 12B v2 VL BF16
Nemotron · Vastined
Params12.3B
Context1024K
Q4_K_M7.5 GB
NE
AceMath RL Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B DFlash
Nemotron · lmstudio-community
Params360M
Context128K
Smallest0.7 GB
NE
Nemotron 3.5 Embed 1B
Nemotron · maternion
Params1.14B
Context256K
Smallest0.9 GB
NE
Nemotron-3.5-Embed-8B
Nemotron · maternion
Params7.95B
Context256K
Q4_K_M4.9 GB
NE
Apriel Nemotron 15b Thinker
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · gabriellarson
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
Elbaz NVIDIA Nemotron 3 Nano 30B A3B PRISM
Nemotron · Ex0bit
Params31.6B
Context1024K
Smallest18.2 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · Litovation
Params638M
Context—
Q4_K_M0.5 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4
Nemotron · prithivMLmods
Params124B
Context1024K
Smallest78.7 GB
NE
FleetWorker E4B
Nemotron · ThakiCloud
Params7.52B
Context64K
Q4_K_M5.3 GB
NE
nvidia OpenCodeReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
Nemotron 3.5 Lightning 30B A3B Heretic Uncensored Q6 K
Nemotron · mlasli
Params31.6B
Context1024K
Smallest33.5 GB
NE
Nemotron 9B OpenCode
Nemotron · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
NE
Snowpiercer 15B v4
Nemotron · TheDrummer
Params15B
Context64K
Q4_K_M9.1 GB
NE
Nemotron Mini 4B Instruct imatrix
Nemotron · duyntnet
Params4.19B
Context4K
Q4_K_M2.7 GB