TileWeave: Heterogeneous tiling for sparse prefill on mobile SoCs
Read the original at arxiv.org→arXiv:2611.00408v1 Announce Type: new Abstract: Smartphone applications increasingly require large language models to process long contexts, whereas high prefill latency and memory demands constrain local inference....
Original headline: "TileWeave: Heterogeneous Tiling for Sparse Prefill on Mobile SoCs"
Coverage timeline
- Nov 3, 05:00 UTC arXiv cs.LG lead source TileWeave: Heterogeneous Tiling for Sparse Prefill on Mobile SoCs