Scaffold effect in coding agents: evaluation varies with harness choice across Qwen 3.6 Plus and MiniMax M2.5
Read the original at arxiv.org→arXiv:2607.22585v1 Announce Type: new Abstract: Public leaderboards for coding agents typically rank systems by model name and pass rate, while the surrounding harness (the scaffold that issues tools, manages...
Original headline: "The Scaffold Effect in Coding Agents: Harness Choice as a Hidden Variable in Coding-Agent Evaluation"
Coverage timeline
- Jul 28, 04:00 UTC arXiv cs.AI lead source The Scaffold Effect in Coding Agents: Harness Choice as a Hidden Variable in Coding-Agent Evaluation