D$^3$-MOPD: adaptive dynamic domain scheDuling for efficient multi-teacher distillation
Read the original at arxiv.org→arXiv:2608.24987v1 Announce Type: new Abstract: Multi-teacher on-policy distillation (MOPD) distills several domain-expert teachers into a single student by minimizing per-domain reverse-KL divergence on the...
Original headline: "D$^3$-MOPD: Adaptive Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation"
Coverage timeline
- Aug 27, 04:00 UTC arXiv cs.LG lead source D$^3$-MOPD: Adaptive Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation