Reverse-engineering the RK3588 NPU: open compiler and runtime enable GPT-2 at 36 tok/s without a vendor SDK
Read the original at old.reddit.com→Last year I posted about hacking the RK3588 NPU to run one vision encoder (previous post). This year I opened the whole thing up: reverse-engineered the register format, built an open compiler + runtime, and now...
Original headline: "Reverse-Engineering the RK3588 NPU: Building an Open Compiler to Run GPT-2 at 36 tok/s"
Coverage timeline
- Aug 19, 18:13 UTC r/LocalLLaMA lead source Reverse-Engineering the RK3588 NPU: Building an Open Compiler to Run GPT-2 at 36 tok/s