Benchmarks are not monolithic: sample-level auditing and orchestration for LLM evaluation show dataset-centric meta-evaluation along five latent dimensions
Read the original at arxiv.org→arXiv:2607.28801v1 Announce Type: new Abstract: Benchmark datasets are central to evaluating Large Language Models (LLMs), yet they are typically conceived as monolithic tasks, obscuring substantial variation in the...
Original headline: "Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation"
Coverage timeline
- Aug 3, 04:00 UTC arXiv cs.CL lead source Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation