Progressive^2: a teacher-student progressive co-evolving knowledge distillation method for substantial model compression
Read the original at arxiv.org→arXiv:2608.00129v1 Announce Type: new Abstract: Knowledge distillation (KD) is a widely utilized technique for transferring knowledge from a large model (the teacher) to a smaller model (the student). Owing to its...
Original headline: "Progressive$^2$: A Teacher-Student Progressive Co-Evolving Knowledge Distillation Method for Substantial Model Compression"
Coverage timeline
- Aug 4, 04:00 UTC arXiv cs.LG lead source Progressive$^2$: A Teacher-Student Progressive Co-Evolving Knowledge Distillation Method for Substantial Model Compression