Whose data, whose benchmark? A user-centric framework for auditing evaluation resources
Read the original at arxiv.org→arXiv:2610.19268v1 Announce Type: new Abstract: Benchmarks shape how model capabilities are measured and interpreted, yet their scores can obscure whose conventions, contexts, and judgments define successful...
Original headline: "Whose Data, Whose Benchmark? A User-Centric Framework for Auditing Evaluation Resources"
Coverage timeline
- Oct 15, 04:00 UTC arXiv cs.CL lead source Whose Data, Whose Benchmark? A User-Centric Framework for Auditing Evaluation Resources