Off-Axis, On Purpose: where a Transformer computes concepts and why it does so
Read the original at arxiv.org→arXiv:2608.10251v1 Announce Type: new Abstract: A transformer's answer lives on one axis: the direction its unembedding reads. Its intermediate states largely do not, and that off-axis position is usually treated as...
Original headline: "Off-Axis, On Purpose: Where a Transformer Computes Concepts and Why it Does So"
Coverage timeline
- Aug 12, 04:00 UTC arXiv cs.CL lead source Off-Axis, On Purpose: Where a Transformer Computes Concepts and Why it Does So