Relevant and Irrelevant: A Renormalization Group Analysis of Transformer Attention
Read the original at arxiv.org→arXiv:2607.15449v1 Announce Type: new Abstract: Using the language of Wilsonian renormalization group theory (RG), we treat the Transformer's attention mechanism as a perturbation of the trained MLP residual-stack...