Nemotron GGUF models
940 GGUF models in the Nemotron family, quantized by 372 uploaders. Sizes run from 10M to 550B parameters. The longest trained context is 1048K tokens.
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Uncensored
Nemotron · AtomicChat
Params74B
Context256K
Q4_K_M51.7 GB
NE
privacy-filter-nemotron
Nemotron · LocalAI-io
Params1.4B
Context128K
Smallest1.6 GB
NE
Nvidia-Nemotron-3-Nano-Omni-30B-A3B-Reasoning
Nemotron · unsloth
Params31.6B
Context1024K
Q4_K_M23.9 GB
NE
NVIDIA Nemotron 3.5 Bolt Turbo Brilliance 50x 74B A9B 24GB
Nemotron · DavidAU
Params74B
Context256K
Smallest1.0 GB
NE
DictaLM 3.0 Nemotron 12B Instruct
Nemotron · dicta-il
Params12.3B
Context1024K
Q4_K_M7.5 GB
NE
Nemotron 3 Nano Omni 30B A3B Reasoning APEX
Nemotron · mudler
Params31.6B
Context1024K
Smallest18.0 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B Uncensored
Nemotron · AtomicChat
Params7.5B
Context64K
Q4_K_M5.1 GB
NE
Nvidia-Nemotron-3-Super-120B-A12B
Nemotron · unsloth
Params121B
Context1024K
Q4_K_M82.5 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B
Nemotron · darioooooo0o
Params74B
Context1024K
Q4_K_M48.3 GB
NE
Nvidia-Nemotron-3-Nano-4B
Nemotron · unsloth
Params3.97B
Context1024K
Q4_K_M2.9 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Abliterated 24GB
Nemotron · BoldingBuilds
Params74B
Context256K
Smallest22.0 GB
NE
NVIDIA-Nemotron-3-Nano-30B-A3B
Nemotron · ggml-org
Params31.6B
Context1024K
Q4_K_M22.4 GB
NE
Nemotron3-Nano-4B-Uncensored-HauhauCS-Aggressive
Nemotron · HauhauCS
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
Nemotron Cascade 2 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
NE
Nvidia-Nemotron-3-Ultra-550B-A55B
Nemotron · unsloth
Params550B
Context1024K
Q4_K_M359.2 GB
NE
Nemotron 3.5 Bolt E4B GSQ RCO
Nemotron · abenzerps
Params7.52B
Context128K
Smallest0.4 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B Pollard
Nemotron · PollardWeights
Params7.52B
Context128K
Q4_K_M0.2 GB
NE
Nemotron 3 Nano 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B 4GB DFlash
Nemotron · nvidia
Params360M
Context128K
Smallest0.7 GB
NE
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
Nemotron · AtomicChat
Params124B
Context1024K
Smallest45.7 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B
Nemotron · lmstudio-community
Params74B
Context256K
Smallest22.0 GB
NE
NVIDIA-Nemotron-3.5-Bolt-E4B
Nemotron · AtomicChat
Params7.52B
Context64K
Q4_K_M5.1 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B Uncensored
Nemotron · AtomicChat
Params124B
Context1024K
Smallest55.8 GB
NE
NVIDIA-Nemotron-3-Nano-30B-A3B
Nemotron · vultr
Params31.6B
Context1024K
Q4_K_M27.0 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B heretic ara i1
Nemotron · spiritfather
Params121B
Context1024K
Q4_K_M86.1 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · bartowski
Params7.52B
Context64K
Q4_K_M5.2 GB
NE
NVIDIA Nemotron 3 Nano 30B A3B
Nemotron · lmstudio-community
Params31.6B
Context1024K
Q4_K_M24.5 GB
NE
Nemotron Cascade 8B Thinking
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
NE
Nemotron 3 Super 120B A12B
Nemotron · lmstudio-community
Params121B
Context1024K
Q4_K_M86.1 GB
NE
Nemotron 3.5 Lightning 30B A3B Heretic Uncensored Q4 K M
Nemotron · mlasli
Params31.6B
Context1024K
Q4_K_M24.5 GB