Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
Nemotron Cc Swedish Tower72B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
OpenMath Nemotron 14B
Nemotron · lmstudio-community
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
Nemotron 3 Super 120B A12B MTP
Nemotron · AlexCaswen
Params4.02B
Context1024K
Smallest8.0 GB
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · GGUF-A-Lot
Params8.89B
Context1024K
Q4_K_M7.1 GB
NE
bibo asr nemotron
Nemotron · fhai50032
Params618M
Context—
Smallest0.7 GB
NE
Nemotron3.3
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Nemotron Cc Cat Opus
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
Nemotron Cc German 9b
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
NVIDIA-Nemotron-3-Ultra-550B-A55B
Nemotron · vultr
Params549B
Context1024K
Q4_K_M379.6 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B LiLiCorr
Nemotron · meshllm
Params1.11B
Context256K
Smallest1.2 GB
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · 1bit-MONSTER
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
NVIDIA Nemotron3 Nano 4B Q4 K M
Nemotron · aoiandroid
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
nemotron 3.5 asr streaming 0.6b
Nemotron · kusema
Params638M
Context—
Smallest0.8 GB
NE
Nemotron 3 Diarization AIPod HF
Nemotron · manateelazycat
Params99M
Context—
Smallest0.1 GB
NE
Nemotron 3 Nano 4B TurboQuant GGUF Q4 K M
Nemotron · majentik
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
OpenCodeReasoning Nemotron 1.1 7B
Nemotron · arnabdhar
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · SandLogicTechnologies
Params1.54B
Context128K
Q4_K_M1.0 GB
NE
Nemotron 3.5 Lightning 30B A3B
Nemotron · el4
Params32.9B
Context1024K
Smallest19.3 GB
NE
Nemotron Cc Finnish Tower9B
Nemotron · mradermacher
Params2.68B
Context2K
Q4_K_M1.7 GB
NE
INT8 nemotron 3.5 asr streaming 0.6b
Nemotron · framadhita
Params638M
Context—
Smallest0.6 GB
NE
AceReason Nemotron 1.1 Offline GRPO 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
Nemotron 3 Nano 30B A3B
Nemotron · Tinker-Stack
Params31.6B
Context1024K
Smallest18.1 GB
NE
NVIDIA-Nemotron-3-Nano-4B
Nemotron · ddh0
Params3.97B
Context1024K
Smallest3.5 GB
NE
Nemotron-3-Diarization
Nemotron · Bonenk
Params99M
Context—
Smallest0.1 GB
NE
Nemotron 3 Nano 4B oss 20b
Nemotron · andersonscode
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
nemotron 3.5 asr 0.6b 325mb
Nemotron · xiaoxiaojian
Params638M
Context—
Smallest0.3 GB
NE
NVIDIA Nemotron Nano 12B v2 VL BF16
Nemotron · brunopio
Params12.3B
Context1024K
Smallest7.5 GB
NE
Fritter Nemotron 0.6B
Nemotron · danielrosehill
Params618M
Context—
Smallest1.2 GB
NE
NemotronLabs AI for Media Sports Tennis GGUF BF16
Nemotron · FedericoFB
Params31.6B
Context1024K
Smallest63.2 GB
NE
nemotron speech streaming 0.6B
Nemotron · m1el
Params618M
Context—
Smallest0.4 GB