Activation-conditioned self-distillation uses activations of self-generated trajectories to steer learning
Read the original at arxiv.org→arXiv:2609.38342v1 Announce Type: new Abstract: On-policy self-distillation uses a model as its own teacher to provide dense supervision for reasoning, often through reference-solution conditioning. Providing...
Original headline: "Activation-Conditioned Self-Distillation"
Coverage timeline
- Oct 1, 04:00 UTC arXiv cs.LG lead source Activation-Conditioned Self-Distillation