Prompt breadth and rollout refresh interact in on-policy distillation; study varies prompt bank and response-generating policy snapshots to evaluate impact on performance
Read the original at arxiv.org→arXiv:2609.25048v1 Announce Type: new Abstract: How many prompts does on-policy distillation (OPD) need, and how does the answer depend on the student policies that generate its training responses? We study these...
Original headline: "Prompt Breadth and Rollout Refresh Interact in On-Policy Distillation"
Coverage timeline
- Sep 23, 04:00 UTC arXiv cs.CL lead source Prompt Breadth and Rollout Refresh Interact in On-Policy Distillation