Attention sensitivity is not enough: dissociating attention-level and behavioural in-context learning under fine-tuning.
Read the original at arxiv.org→arXiv:2609.00064v1 Announce Type: new Abstract: In-context learning (ICL) lets large language models adapt to new tasks from demonstrations, and fine-tuning can erode this behaviour. Many preservation diagnostics...
Original headline: "Attention Sensitivity Is Not Enough: Dissociating Attention-Level and Behavioural In-Context Learning under Fine-Tuning"
Coverage timeline
- Sep 2, 04:00 UTC arXiv cs.LG lead source Attention Sensitivity Is Not Enough: Dissociating Attention-Level and Behavioural In-Context Learning under Fine-Tuning