On-policy distillation meets off-policy GRPO: training compact instruction-following rerankers
Read the original at arxiv.org→arXiv:2609.01947v1 Announce Type: new Abstract: Compact instruction-following rerankers are attractive for deployment, but conventional distillation pipelines typically train students by offline imitation of teacher...
Original headline: "On-Policy Distillation Meets Off-Policy GRPO: Training Compact Instruction-Following Rerankers"
Coverage timeline
- Sep 3, 04:00 UTC arXiv cs.LG lead source On-Policy Distillation Meets Off-Policy GRPO: Training Compact Instruction-Following Rerankers