Slow-Fast multi-teacher on-policy distillation for capability preservation
Read the original at arxiv.org→arXiv:2610.02324v1 Announce Type: new Abstract: Foundation multimodal large language models are designed to support a broad spectrum of capabilities across diverse domains. Multi-teacher on-policy distillation...
Original headline: "Slow-Fast Multi-Teacher On-Policy Distillation for Capability Preservation"
Coverage timeline
- Oct 5, 04:00 UTC arXiv cs.LG lead source Slow-Fast Multi-Teacher On-Policy Distillation for Capability Preservation
- Oct 5, 04:00 UTC arXiv cs.LG Lexicographic Multi-Objective On-Policy Distillation