Capability-aware multi-teacher on-policy distillation improves supervision allocation during on-policy learning
Read the original at arxiv.org→arXiv:2610.26950v2 Announce Type: new Abstract: Multi-teacher on-policy distillation (MOPD) integrates domain specialists into a shared student, but determining how strongly each teacher should supervise remains...
Original headline: "Beyond Policy Discrepancy: Capability-Aware Multi-Teacher On-Policy Distillation"
Coverage timeline
- Oct 21, 04:00 UTC arXiv cs.LG lead source Beyond Policy Discrepancy: Capability-Aware Multi-Teacher On-Policy Distillation