Rewriting scaling laws for synthetic data with compute and data constraints
Read the original at arxiv.org→arXiv:2610.31867v1 Announce Type: new Abstract: Synthetic rewrites, where a language model rewrites a natural document e.g. into a target style, are now a standard ingredient of pretraining corpora. However,...
Original headline: "Rewriting Scaling Laws for Synthetic Data with Compute and Data Constraints"
Coverage timeline
- Oct 26, 04:00 UTC arXiv cs.LG lead source Rewriting Scaling Laws for Synthetic Data with Compute and Data Constraints