Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron Cascade 14B Thinking Impotent Heresy
Nemotron · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
NE
Apriel Nemotron 15b Thinker Magic_decensored_MPOA
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
NE
Nemotron SEA LION v4.8 30B A3B Base
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
NemotronLabs AI for Media Sports Tennis GGUF MXFP4
Nemotron · FedericoFB
Params31.6B
Context1024K
Smallest18.0 GB
ReasoningTool useVision
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B Abliterated
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
NE
Openbuddy Nemotron 70b V23.2Q 131k
Nemotron · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
NVIDIA Nemotron 3.5 Bolt E4B IQ4
Nemotron · FP8Enjoyer
Params7.52B
Context64K
Smallest4.0 GB
ReasoningTool use
NE
GaMS 9B Instruct Nemotron
Nemotron · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · cstr
Params638M
Context—
Smallest0.4 GB
GGUF
NE
openthai2.0 legal thaillm nemotron 3 nano 30b a3b
Nemotron · iapp
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
NE
Nemotron 3.5 Lightning Omni 30B A3B
Nemotron · engram-ae
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool useVision
NE
Nemotron Terminal 8B
Nemotron · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CodingReasoningTool use
NE
Ea_Final_Nvidia_Nemotron_3_Super_120B_A12B_Bf16_030326_Vv0.1
Nemotron · ggml-org
Params121B
Context1024K
Smallest69.9 GB
GGUF
NE
nvidia__NVIDIA Nemotron Nano 9B v2
Nemotron · dominguesm
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 12B v2 VL BF16
Nemotron · Vastined
Params12.3B
Context1024K
Q4_K_M7.5 GB
ReasoningTool useVision
NE
AceMath RL Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Bolt E4B DFlash
Nemotron · lmstudio-community
Params360M
Context128K
Smallest0.7 GB
ReasoningTool use
NE
Nemotron 3.5 Embed 1B
Nemotron · maternion
Params1.14B
Context256K
Smallest0.9 GB
EmbeddingVision
NE
Nemotron-3.5-Embed-8B
Nemotron · maternion
Params7.95B
Context256K
Q4_K_M4.9 GB
EmbeddingVision
NE
Apriel Nemotron 15b Thinker
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
NE
OpenReasoning Nemotron 1.5B
Nemotron · gabriellarson
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingReasoning
NE
Elbaz NVIDIA Nemotron 3 Nano 30B A3B PRISM
Nemotron · Ex0bit
Params31.6B
Context1024K
Smallest18.2 GB
CodingReasoningTool use
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · Litovation
Params638M
Context—
Q4_K_M0.5 GB
GGUF
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4
Nemotron · prithivMLmods
Params124B
Context1024K
Smallest78.7 GB
ReasoningTool useVision
NE
FleetWorker E4B
Nemotron · ThakiCloud
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool useVision
NE
nvidia OpenCodeReasoning Nemotron 7B
Nemotron · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
Nemotron 3.5 Lightning 30B A3B Heretic Uncensored Q6 K
Nemotron · mlasli
Params31.6B
Context1024K
Smallest33.5 GB
ReasoningRoleplayTool use
NE
Nemotron 9B OpenCode
Nemotron · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
NE
Snowpiercer 15B v4
Nemotron · TheDrummer
Params15B
Context64K
Q4_K_M9.1 GB
Reasoning
NE
Nemotron Mini 4B Instruct imatrix
Nemotron · duyntnet
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use

Keep browsing