Nemotron 3.5 Bolt E4B runs at 27.7 tok/s on Jetson Orin Nano Super, outperforming the official release on Llama CPP by about 1.8x
Read the original at www.reddit.com→Hi! I wanted to share that we just got NVIDIA's latest Nemotron Bolt model running at 27.7 tok/s (compared to 15 tok/s on the official release with Llama CPP) on Jetson Orin Nano Super (1.8x faster)! It can program...
Original headline: "Nemotron 3.5 Bolt E4B on Jetson Orin Nano Super at 27.7 tok/s!"
Coverage timeline
- Nov 5, 17:20 UTC r/LocalLLaMA lead source Nemotron 3.5 Bolt E4B on Jetson Orin Nano Super at 27.7 tok/s!