Prefix-tuning enables parameter-efficient steering of pretrained transformers by prepending task-specific prefixes to inputs
Read the original at arxiv.org→arXiv:2610.24123v1 Announce Type: new Abstract: Prefix-tuning is a parameter-efficient fine-tuning method for large language models (LLMs) that steers model outputs by prepending task-specific prefix representations...
Original headline: "Prefix-Tuning for Arbitrary Output Sequences on Pretrained Transformers"
Coverage timeline
- Oct 20, 04:00 UTC arXiv cs.CL lead source Prefix-Tuning for Arbitrary Output Sequences on Pretrained Transformers