AI labs report benchmark scores 6.4% higher on average than independent testers for the same models and tests

I've been building whatmodel.sh, an open source AI leaderboard, and wanted to see how a labs' own benchmark scores compare with independent testers. Using 1,629 published benchmark results, I matched 611 comparisons...