CAFE: Confining feature distillation to language-routed adapters for compact multilingual ASR lowers word error rate; arXiv:2610.19134 discusses gradient behavior of feature losses.
Read the original at arxiv.org→arXiv:2610.19134v1 Announce Type: new Abstract: Feature distillation is usually expected to add to logit distillation. We find that this expectation does not hold for two common feature losses in compact...
Original headline: "CAFE: Confining Feature Distillation to Language-Routed Adapters for Compact Multilingual Automatic Speech Recognition"
Coverage timeline
- Oct 15, 04:00 UTC arXiv cs.CL lead source CAFE: Confining Feature Distillation to Language-Routed Adapters for Compact Multilingual Automatic Speech Recognition