Prompt lottery in LLM-as-a-judge: measuring and mitigating sensitivity to syntactic rephrasing
Read the original at arxiv.org→arXiv:2610.38076v1 Announce Type: new Abstract: LLM-as-a-Judge has become a standard for evaluating large language models, yet most approaches implicitly assume that a single judge prompt functions as a stable...
Original headline: "Prompt Lottery in LLM-as-a-Judge: Measuring and Mitigating Sensitivity to Syntactic Rephrasing"
Coverage timeline
- Oct 30, 04:00 UTC arXiv cs.CL lead source Prompt Lottery in LLM-as-a-Judge: Measuring and Mitigating Sensitivity to Syntactic Rephrasing