Procedural knowledge is not low-rank: LoRA fails to internalize multi-step procedures
Read the original at arxiv.org→arXiv:2607.21612v1 Announce Type: new Abstract: Parameter-efficient fine-tuning methods like LoRA have become the default for adapting large language models, succeeding across instruction following, style transfer,...
Original headline: "Procedural Knowledge Is Not Low-Rank: Why LoRA Fails to Internalize Multi-Step Procedures"
Coverage timeline
- Jul 27, 04:00 UTC arXiv cs.AI lead source Procedural Knowledge Is Not Low-Rank: Why LoRA Fails to Internalize Multi-Step Procedures