Using parallel data at scale for multilingual pretraining; arXiv study analyzes leveraging parallel structure in multilingual pretraining
Read the original at arxiv.org→arXiv:2610.28838v1 Announce Type: new Abstract: High-quality human-translated parallel corpora can improve cross-lingual transfer, but are typically too small for large-scale pretraining. Machine-translated web...
Original headline: "How to Use Parallel Data for Multilingual Pretraining"
Coverage timeline
- Oct 22, 04:00 UTC arXiv cs.CL lead source How to Use Parallel Data for Multilingual Pretraining