TRACE: Transformer residual activation codebook encoding for communication-efficient distributed edge inference
Read the original at arxiv.org→arXiv:2610.22435v1 Announce Type: new Abstract: Distributed Transformer inference across co-located edge devices is fundamentally communication-bound, as exchanging activations between sequence-parallel partitions...
Original headline: "TRACE: Transformer Residual Activation Codebook Encoding for Communication-efficient Distributed Edge Inference"
Coverage timeline
- Oct 19, 04:00 UTC arXiv cs.LG lead source TRACE: Transformer Residual Activation Codebook Encoding for Communication-efficient Distributed Edge Inference