NVIDIA releases Nemotron Bolt 3.5 74B A9B with 74B parameters on Oct. 15, using 2-bit quantization and MoE architecture; Nemotron 3.5 Bolt E4B 4GB follows on Oct. 23.
Read the original at www.reddit.com→This model is a 74B parameter, 9B-active-parameter mixture-of-experts (MoE) model, packed into 24GB using 2-bit quantization with advanced quantization-aware training techniques to retain quality. It aims to achieve...
Original headline: "NVIDIA Nemotron Bolt 3.5 74B A9B releases Oct. 15th"
Coverage timeline
- Oct 14, 14:42 UTC r/LocalLLaMA lead source NVIDIA Nemotron Bolt 3.5 74B A9B releases Oct. 15th
- Oct 14, 14:50 UTC Hacker News (AI) Nvidia's Nemotron 3.5 Bolt 74B Brings 74B AI Models to Local Hardware