Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · ijohn07
Params4.41B
Context256K
Smallest4.7 GB
CodingReasoning
NE
Nemotron Speech Streaming EN
Nemotron · myflow-ai
Params618M
Context—
Smallest0.7 GB
GGUF
NE
blackout buddy nemotron lora kn
Nemotron · mitvho09
Params21M
Context—
Smallest0.0 GB
GGUF
NE
NVIDIA Nemotron 3 Ultra 550B A55B BF16
Nemotron · ddh0
Params549B
Context1024K
Smallest156.2 GB
ReasoningTool use
NE
Nemotron Mini 4B Instruct Q4 K M
Nemotron · Solshine
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
Nemotron Cascade 2 30B A3B Q5 1
Nemotron · AdrienBrault
Params31.6B
Context1024K
Smallest23.8 GB
ReasoningTool use
NE
nvidia OpenCodeReasoning Nemotron 1.1 32B
Nemotron · tensorblock
Params32.8B
Context64K
Smallest12.3 GB
CodingReasoningTool use
NE
OpenMath Nemotron 1.5B
Nemotron · devisri050
Params1.54B
Context128K
Smallest1.6 GB
Reasoning
NE
Nemotron 4 Mini Hindi 4b Base
Nemotron · itlwas
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
Nemotron Speech Streaming EN
Nemotron · memoravox
Params618M
Context—
Smallest0.7 GB
GGUF
NE
Orchestrator 8B
Nemotron · AXONVERTEX-AI-RESEARCH
Params8.19B
Context40K
Smallest8.7 GB
ReasoningTool use
NE
Nemotron Mini 4B Instruct IQ4 NL
Nemotron · performanceoptician
Params4.19B
Context4K
Smallest2.6 GB
Tool use
NE
Nemotron Orchestrator 8B
Nemotron · Trisert
Params8.19B
Context40K
Smallest8.7 GB
ReasoningTool use
NE
mini bella test nemotron 8B
Nemotron · Naphula
Params8.04B
Context1048K
Q4_K_M4.9 GB
GGUF
NE
Nemotron Mini 4B Instruct Q4 0
Nemotron · BernTheCreator
Params4.19B
Context4K
Smallest2.6 GB
Tool use
NE
Nemotron W 4b Halo 0.1
Nemotron · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
NE
OpenReasoning Nemotron 32B
Nemotron · sm54
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingReasoning
NE
OpenReasoning Nemotron 32B
Nemotron · Ericwang
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingReasoning
NE
Nemotron Cascade 2 30B A3B TurboQuant GGUF Q5 K M
Nemotron · majentik
Params31.6B
Context1024K
Smallest26.0 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · GrimsenClory
Params12.3B
Context1024K
Smallest10.1 GB
ReasoningTool use
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · nodcai
Params648M
Context—
Smallest0.5 GB
GGUF
NE
Nemotron Cascade 14B Thinking
Nemotron · c1t1zen
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
NE
Nemotron Research GooseReason 4B Instruct
Nemotron · ijohn07
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingReasoning
NE
OpenMath Nemotron 1.5B
Nemotron · devisri050
Params1.54B
Context128K
Smallest0.9 GB
Reasoning
NE
Nemotron 49b v1 Intern NLQ Merged
Nemotron · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
NE
OpenCodeReasoning Nemotron 1.1 14B Q4 K M
Nemotron · NikolayKozloff
Params14.8B
Context64K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
PhoneLLM Alpha 1 ROCmFP4 STRIX LEAN
Nemotron · kingjones777
Params31.6B
Context1024K
Smallest17.1 GB
ReasoningTool use
NE
Zytturm 8b
Nemotron · IMF2000
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
NE
OpenCodeReasoning Nemotron 1.1 7B Q8 0
Nemotron · NikolayKozloff
Params7.62B
Context32K
Smallest8.1 GB
CodingReasoningTool use
NE
Nemotron Cascade 14B Thinking Claude 4.5 Opus High Reasoning Distill
Nemotron · bacsidangnguyen
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use

Keep browsing