PreSO: Privileged representation isolation for on-policy self-distillation
Read the original at arxiv.org→arXiv:2610.14001v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) uses a self-teacher conditioned on privileged information to turn the sparse outcome signal of reinforcement learning with...
Original headline: "PreSO: Privileged Representation Isolation for On-Policy Self-Distillation"
Coverage timeline
- Oct 14, 04:00 UTC arXiv cs.LG lead source PreSO: Privileged Representation Isolation for On-Policy Self-Distillation
- Oct 14, 04:00 UTC arXiv cs.LG OPMD: On-Policy Mechanism Distillation Beyond Output Supervision