Some tokens act like magnets, revealing linguistic organization in language model layers
Read the original at arxiv.org→arXiv:2609.05743v1 Announce Type: new Abstract: We identify a special group of token vectors inside large language models (LLMs), which we term magnetic vectors, that organize the surrounding tokens by either...
Original headline: "Some Tokens Behave like Magnets: Revealing Linguistic Organization in the Layers of Language Models"
Coverage timeline
- Sep 9, 04:00 UTC arXiv cs.CL lead source Some Tokens Behave like Magnets: Revealing Linguistic Organization in the Layers of Language Models