ChainDoRA: Tensor-Train factorized weight-decomposed low-rank adaptation for parameter-efficient LLM fine-tuning
Read the original at arxiv.org→arXiv:2609.25058v1 Announce Type: new Abstract: Parameter-efficient fine-tuning (PEFT) adapts large language models (LLMs) to downstream tasks while updating only a small fraction of their pretrained parameters....
Original headline: "ChainDoRA: Tensor-Train Factorized Weight-Decomposed Low-Rank Adaptation for Parameter-Efficient LLM Fine-Tuning"
Coverage timeline
- Sep 23, 04:00 UTC arXiv cs.CL lead source ChainDoRA: Tensor-Train Factorized Weight-Decomposed Low-Rank Adaptation for Parameter-Efficient LLM Fine-Tuning