Weight-aware streaming tensor engine runs Kimi K3 using 29 GB of RAM at 0.50 tok/s
Read the original at old.reddit.com→submitted by /u/galapag0 [link] [comments]
Original headline: "Weight-Aware Streaming Tensor Engine: run Kimi K3 using 29 GB of RAM at 0.50 tok/s"
Coverage timeline
- Aug 1, 08:09 UTC r/LocalLLaMA lead source Weight-Aware Streaming Tensor Engine: run Kimi K3 using 29 GB of RAM at 0.50 tok/s