Adaptive reciprocal knowledge distillation preserves category correlation knowledge by adjusting teacher-student guidance during training.
Read the original at arxiv.org→arXiv:2609.13199v1 Announce Type: new Abstract: Knowledge distillation aims to improve the performance of lightweight student models by transferring knowledge from larger and more powerful teacher models. However, a...
Original headline: "Discovering and Preserving Category Correlation Knowledge via Adaptive Reciprocal Knowledge Distillation"
Coverage timeline
- Sep 15, 04:00 UTC arXiv cs.LG lead source Discovering and Preserving Category Correlation Knowledge via Adaptive Reciprocal Knowledge Distillation