Mitigating capability degradation in LLM self-improvement via representation geometry regularization
Read the original at arxiv.org→arXiv:2610.12855v1 Announce Type: new Abstract: On-Policy Self-distillation is a self-improvement paradigm that enables large language models (LLMs) to improve their capabilities by leveraging the same model as both...
Original headline: "Mitigating Capability Degradation in LLM Self-Improvement via Representation Geometry Regularization"
Coverage timeline
- Oct 12, 04:00 UTC arXiv cs.AI lead source Mitigating Capability Degradation in LLM Self-Improvement via Representation Geometry Regularization