Nemotron 3.5 Bolt is suitable for small multiuser workloads, with quantization noted as a strength
Read the original at www.reddit.com→https://preview.redd.it/0tljsfsl7cwh1.png?width=349&format=png&auto=webp&s=4428c2ab4743ce471d2862eef502ffa38381c8d3 I have been shopping for a faster model than 27B for a workload that Nemotron Ultra was doing well...
Original headline: "Nemotron 3.5 Bolt is okayish for small multiuser setups"
Coverage timeline
- Oct 19, 02:48 UTC r/LocalLLaMA lead source Nemotron 3.5 Bolt is okayish for small multiuser setups