Geometric and behavioral stratification in transformer residual streams
Read the original at arxiv.org→arXiv:2608.12447v1 Announce Type: new Abstract: Trained transformer models develop privileged bases: coordinate axes whose statistics differ from the rest of the residual stream. But what kind of direction does such...
Original headline: "Geometric and Behavioral Stratification in Transformer Residual Streams"
Coverage timeline
- Aug 14, 04:00 UTC arXiv cs.LG lead source Geometric and Behavioral Stratification in Transformer Residual Streams