The Wording Effect: rephrasing a problem with the same meaning can flip an LLM’s answer, causing bidirectional drift in benchmark performance.
Read the original at arxiv.org→arXiv:2608.11694v1 Announce Type: new Abstract: A benchmark score comes from a single phrasing of each problem. That single phrasing is treated as if it stood for the whole space of ways the same problem could be...
Original headline: "The Wording Effect: Quantifying Two-Way Drift in LLM Benchmark Performance"
Coverage timeline
- Aug 13, 04:00 UTC arXiv cs.CL lead source The Wording Effect: Quantifying Two-Way Drift in LLM Benchmark Performance