Entity tracking emerges in sub-billion parameter language models and exceeds human performance in naturalistic narratives

arXiv:2608.18083v1 Announce Type: new Abstract: Understanding language requires tracking entities across discourse - i.e., knowing where things are and how they change, even when not explicitly stated. Whether...