LeakScale estimates the causal effect of benchmark exposure by creating fresh executable tasks to quantify performance attributable to training data contact.
Read the original at arxiv.org→arXiv:2609.27176v1 Announce Type: new Abstract: Evidence that evaluation material entered training does not reveal how much it affected evaluation. This distinction leaves a contaminated benchmark score difficult to...
Original headline: "Beyond Overlap: Estimating the Causal Effect of Benchmark Exposure"
Coverage timeline
- Sep 24, 04:00 UTC arXiv cs.CL lead source Beyond Overlap: Estimating the Causal Effect of Benchmark Exposure