Running local LLMs on Orange Pi 5 Plus with RK3588: Ollama throughput gains from core pinning and NPU offloading; thermals and Tok/s measured
Read the original at www.reddit.com→Disclosure: This unit was provided free of charge by Orange Pi for testing. No editorial review, no preconditions, no script. All data, bottlenecks, and thermal behavior are reported directly from hardware testing. ...
Original headline: "[Benchmark] Running Local LLMs on Orange Pi 5 Plus (RK3588, 16GB): Ollama Tok/s, NPU Offloading, Core Pinning & Thermals"
Coverage timeline
- Oct 6, 08:31 UTC r/LocalLLaMA lead source [Benchmark] Running Local LLMs on Orange Pi 5 Plus (RK3588, 16GB): Ollama Tok/s, NPU Offloading, Core Pinning & Thermals