Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron Cascade 14B Thinking Claude 4.5 Opus Distill.q4 k m
Nemotron · Manojb
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
NE
alecv nemotron q3 k m
Nemotron · alecv
Params3.97B
Context1024K
Smallest2.4 GB
CodingReasoningTool use
NE
gguf Q5 K L Nemotron Mini 4B Instruct
Nemotron · Felladrin
Params4.19B
Context4K
Smallest3.5 GB
Tool use
NE
OpenReasoning Nemotron 7B
Nemotron · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
CodingReasoning
NE
Nemotron Cascade 14B Thinking Claude 4.5 Opus Distill.iq4 nl
Nemotron · Manojb
Params14.8B
Context32K
Smallest8.5 GB
ReasoningTool use
NE
Nemotron 3.5 Bolt E4B
Nemotron · HYDRACODEX
Params7.52B
Context64K
Q4_K_M6.2 GB
ReasoningTool use
NE
nemotron3 diar plus x asr
Nemotron · Luigi
Params253M
Context—
Smallest0.3 GB
GGUF
NE
OpenReasoning Nemotron 1.5B
Nemotron · yasserrmd
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
NE
Openhands Nemotron 32B Karcher 300
Nemotron · win10
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
NE
Nemotron
Nemotron · TOTORONG
Params49.9B
Context128K
Smallest35.4 GB
GGUF
NE
nemotron cascade 2 attn repeat L5
Nemotron · audreyt
Params31.6B
Context256K
Q4_K_M24.3 GB
GGUF
NE
Nemotron Cascade 8B Thinking Claude 4.5 Opus Distill.q8 0
Nemotron · Manojb
Params8.19B
Context32K
Smallest8.7 GB
ReasoningTool use
NE
Nemotron Cascade 2 30B A3B Q5 K M
Nemotron · AdrienBrault
Params31.6B
Context1024K
Smallest26.0 GB
ReasoningTool use
NE
Nemotron Labs GGUF development
Nemotron · IntellAgents
Params3.83B
Context256K
Q4_K_M2.4 GB
ReasoningTool useVision
NE
nvidia/Nemotron-3-Embed-1B-BF16
Nemotron · ldov
Params14.8B
Context256K
Q4_K_M0.7 GB
EmbeddingReasoningTool use
NE
OpenReasoning Nemotron 14B
Nemotron · sandner
Params14.8B
Context128K
Smallest10.5 GB
CodingReasoning
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · Tobivictor
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
Nvidia-Nemotron-3-Super-120B-A12B
Nemotron · inference-snaps
Params121B
Context1024K
Q4_K_M82.5 GB
ReasoningTool use
NE
Nemotron Streaming 3.5
Nemotron · CharlsVtT
Params638M
Context—
Smallest0.8 GB
GGUF
NE
openbuddy nemotron 70b v23.2 131k
Nemotron · OpenBuddy
Params70.6B
Context128K
Smallest34.3 GB
GGUF
NE
Nemotron 70B Instruct HF Q8 8parts
Nemotron · sdyy
Params70.6B
Context128K
Smallest75.0 GB
Tool use
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · vokra
Params638M
Context—
Smallest2.6 GB
GGUF
NE
Nemotron Orchestrator 8B
Nemotron · hacer201145
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · EspacioDigitalCl
Params638M
Context—
Smallest0.8 GB
GGUF
NE
streaming speech translation
Nemotron · pltobing
Params3.88B
Context128K
Q4_K_M2.5 GB
Coding
NE
Nemotron 3.5 Lightning 30B A3B abliterated cyber GLP 51 L1 51 a1.0
Nemotron · msuiche
Params30B
Context—
Smallest0.0 GB
GGUF
NE
AceReason Nemotron 14B
Nemotron · MaoyueOUO
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
NE
Nemotron 3 Nano 4B
Nemotron · memoryco-ai
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
OpenReasoning Nemotron 7B
Nemotron · usutyono
Params7.62B
Context128K
Smallest8.1 GB
Reasoning
NE
nemotron nano 4b asvab phase2
Nemotron · davyalan1
Params4.51B
Context128K
Smallest3.2 GB
Tool use

Keep browsing