Nemotron GGUF models

940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
NE
Stockmark Nemotron 3 Nano Omni JapanDocReader
Nemotron · dtrknt
Params31.6B
Context1024K
Smallest20.7 GB
ReasoningTool useVision
NE
OpenReasoning Nemotron 1.5B
Nemotron · Edge-Quant
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingReasoning
NE
Nemotron3 Nano 4B Aggressive GenRM
Nemotron · VECTORVV1
Params3.97B
Context1024K
Smallest2.2 GB
ReasoningTool use
NE
Nemotron Mini 4B Instruct GGUF FP16
Nemotron · medmekk
Params4.19B
Context4K
Smallest8.4 GB
Tool use
NE
Nemotron Mini 4B Instruct
Nemotron · medmekk
Params4.19B
Context4K
Smallest8.4 GB
Tool use
NE
Apriel Nemotron 15b Thinker
Nemotron · GrimsenClory
Params15B
Context64K
Smallest12.3 GB
ReasoningTool use
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · Dazarang
Params638M
Context—
Q4_K_M0.5 GB
GGUF
NE
Nemotron H 4B Instruct
Nemotron · sommerzen
Params4.49B
Context1024K
Smallest4.8 GB
GGUF
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
CodingReasoning
NE
Nemotron Mini 4B Instruct Q4 K M
Nemotron · TerraNTR
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
Nemotron 3 Nano 4B RotorQuant GGUF IQ4 XS
Nemotron · majentik
Params3.97B
Context1024K
Smallest2.4 GB
ReasoningTool use
NE
OpenCodeReasoning Nemotron 1.1 14B Q4 K S
Nemotron · NikolayKozloff
Params14.8B
Context64K
Smallest8.6 GB
CodingReasoningTool use
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · Aashraf995
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
NE
Nemotron 4 Mini Hindi 4b Instruct
Nemotron · itlwas
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
NE
AceReason Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
CodingReasoningTool use
NE
AceReason Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · mwcircle
Params12.3B
Context1024K
Smallest10.1 GB
ReasoningTool use
NE
Orchestrator 8B
Nemotron · Edge-Quant
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
NE
roc stance vector bolt 74b
Nemotron · dAAAb
Params74B
Context—
Smallest0.0 GB
GGUF
NE
Nemotron W 4b MagLight 0.1 i1
Nemotron · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
NE
Mirage OpenReasoning Nemotron 7B
Nemotron · Bifrost-AI
Params7.62B
Context128K
Smallest15.2 GB
CodingReasoning
NE
blackout buddy nemotron lora de
Nemotron · mitvho09
Params21M
Context—
Smallest0.0 GB
GGUF
NE
Nemotron Cascade 14B Thinking
Nemotron · linkmaniatic
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
NE
Gambit 7B Q4 K M
Nemotron · IntelligentEstate
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoningTool use
NE
Prism 4B Reasoning
Nemotron · GYETI
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
FinNemotron R1
Nemotron · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
NE
OpenReasoning Nemotron 1.5B
Nemotron · NikolayKozloff
Params1.54B
Context128K
Smallest1.6 GB
CodingReasoning
NE
Nemotron Terminal 14B
Nemotron · Aminfri
Params14.8B
Context40K
Q4_K_M9.0 GB
Coding
NE
retro alpha nemotron
Nemotron · sankalphs
Params3.97B
Context1024K
Q4_K_M2.8 GB
ReasoningTool use
NE
Nemotron Cascade 8B Thinking Claude 4.5 Opus Distill.q4 k m
Nemotron · Manojb
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use

Keep browsing