Learning from synthetic data without model collapse in iterative instruction tuning

arXiv:2607.17043v1 Announce Type: new Abstract: Model collapse is a central challenge in learning from synthetic data: as later-generation large language models (LLMs) are trained on an increasing proportion of...