High-dimensional layer-state trajectories reveal the internal dynamics of transformer inference
Read the original at arxiv.org→arXiv:2610.26866v1 Announce Type: new Abstract: Mechanistic studies of large language models localize function in parameters, attention heads or neurons, but those parts do not specify how one inference unfolds. We...
Coverage timeline
- Oct 21, 04:00 UTC arXiv cs.LG lead source High-dimensional layer-state trajectories reveal the internal dynamics of transformer inference