Richness Is Not Evenness: Ordered Renyi Crossings under Self-Training

arXiv:2611.08892v1 Announce Type: new Abstract: Recursive self-training of language models, a setting studied in model collapse, can reduce vocabulary while making frequent words, mostly function words, less...