Informational antilocality and the locality bias in LLMs
Read the original at arxiv.org→arXiv:2608.27760v1 Announce Type: new Abstract: We consider the ability of transformer-based language models (LLMs) to learn what we call k-antilocal languages, i.e., languages that have no mutual information across...
Original headline: "Informational Antilocality and the Locality Bias in LLMs"
Coverage timeline
- Aug 31, 04:00 UTC arXiv cs.CL lead source Informational Antilocality and the Locality Bias in LLMs