Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
Nemotron Cascade 14B Thinking Claude 4.5 Opus Distill.q4 k m
Nemotron · Manojb
Params14.8B
Context32K
Q4_K_M9.0 GB
NE
alecv nemotron q3 k m
Nemotron · alecv
Params3.97B
Context1024K
Smallest2.4 GB
NE
gguf Q5 K L Nemotron Mini 4B Instruct
Nemotron · Felladrin
Params4.19B
Context4K
Smallest3.5 GB
NE
OpenReasoning Nemotron 7B
Nemotron · NikolayKozloff
Params7.62B
Context128K
Smallest8.1 GB
NE
Nemotron Cascade 14B Thinking Claude 4.5 Opus Distill.iq4 nl
Nemotron · Manojb
Params14.8B
Context32K
Smallest8.5 GB
NE
Nemotron 3.5 Bolt E4B
Nemotron · HYDRACODEX
Params7.52B
Context64K
Q4_K_M6.2 GB
NE
nemotron3 diar plus x asr
Nemotron · Luigi
Params253M
Context—
Smallest0.3 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · yasserrmd
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
Openhands Nemotron 32B Karcher 300
Nemotron · win10
Params32.8B
Context32K
Q4_K_M19.9 GB
NE
Nemotron
Nemotron · TOTORONG
Params49.9B
Context128K
Smallest35.4 GB
NE
nemotron cascade 2 attn repeat L5
Nemotron · audreyt
Params31.6B
Context256K
Q4_K_M24.3 GB
NE
Nemotron Cascade 8B Thinking Claude 4.5 Opus Distill.q8 0
Nemotron · Manojb
Params8.19B
Context32K
Smallest8.7 GB
NE
Nemotron Cascade 2 30B A3B Q5 K M
Nemotron · AdrienBrault
Params31.6B
Context1024K
Smallest26.0 GB
NE
Nemotron Labs GGUF development
Nemotron · IntellAgents
Params3.83B
Context256K
Q4_K_M2.4 GB
NE
nvidia/Nemotron-3-Embed-1B-BF16
Nemotron · ldov
Params14.8B
Context256K
Q4_K_M0.7 GB
NE
OpenReasoning Nemotron 14B
Nemotron · sandner
Params14.8B
Context128K
Smallest10.5 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · Tobivictor
Params8.89B
Context1024K
Q4_K_M6.5 GB
NE
Nvidia-Nemotron-3-Super-120B-A12B
Nemotron · inference-snaps
Params121B
Context1024K
Q4_K_M82.5 GB
NE
Nemotron Streaming 3.5
Nemotron · CharlsVtT
Params638M
Context—
Smallest0.8 GB
NE
openbuddy nemotron 70b v23.2 131k
Nemotron · OpenBuddy
Params70.6B
Context128K
Smallest34.3 GB
NE
Nemotron 70B Instruct HF Q8 8parts
Nemotron · sdyy
Params70.6B
Context128K
Smallest75.0 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · vokra
Params638M
Context—
Smallest2.6 GB
NE
Nemotron Orchestrator 8B
Nemotron · hacer201145
Params8.19B
Context40K
Q4_K_M5.0 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · EspacioDigitalCl
Params638M
Context—
Smallest0.8 GB
NE
streaming speech translation
Nemotron · pltobing
Params3.88B
Context128K
Q4_K_M2.5 GB
NE
Nemotron 3.5 Lightning 30B A3B abliterated cyber GLP 51 L1 51 a1.0
Nemotron · msuiche
Params30B
Context—
Smallest0.0 GB
NE
AceReason Nemotron 14B
Nemotron · MaoyueOUO
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
Nemotron 3 Nano 4B
Nemotron · memoryco-ai
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
OpenReasoning Nemotron 7B
Nemotron · usutyono
Params7.62B
Context128K
Smallest8.1 GB
NE
nemotron nano 4b asvab phase2
Nemotron · davyalan1
Params4.51B
Context128K
Smallest3.2 GB