LARA: Lightweight Additive Residual Adaptation operates in the residual stream for model adaptation without updating base weights; evaluated on a code fine-tuning task and on preference optimization (DPO)
Read the original at arxiv.org→arXiv:2607.28669v1 Announce Type: new Abstract: We present LARA (Lightweight Additive Residual Adaptation), a method for efficient adaptation that operates in the residual stream of a frozen model rather than in its...
Original headline: "LARA: Lightweight Adapters in the Residual Stream for Composable Adaptation and Alignment"
Coverage timeline
- Aug 3, 04:00 UTC arXiv cs.LG lead source LARA: Lightweight Adapters in the Residual Stream for Composable Adaptation and Alignment