Predicting privileged information effectiveness for on-policy self-distillation
Read the original at arxiv.org→arXiv:2610.22512v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) enables large language models (LLMs) to learn from privileged information (PI) without a separate teacher model. However, prior work...
Original headline: "Predicting Privileged Information Effectiveness for On-Policy Self-Distillation"
Coverage timeline
- Oct 19, 04:00 UTC arXiv cs.LG lead source Predicting Privileged Information Effectiveness for On-Policy Self-Distillation