Demystifying On-Policy Distillation: Roles, Pathologies, and Regulations
Read the original at arxiv.org→arXiv:2607.13399v1 Announce Type: new Abstract: On-policy distillation (OPD) has become a key paradigm in LLM post-training, yet its training dynamics remain poorly understood. We present a systematic study...
Coverage timeline
- Jul 16, 04:00 UTC arXiv cs.CL lead source Demystifying On-Policy Distillation: Roles, Pathologies, and Regulations