Hidden costs of reading LLM judges from the first token verdict; reading the first generated token distorts position bias under constrained decoding and likelihood scoring, study finds
Read the original at arxiv.org→arXiv:2610.00054v1 Announce Type: new Abstract: Reading an LLM judge's verdict from the logits of its first generated token is cheap, requires no generation, and is exactly what constrained decoding and...
Original headline: "The First Token Is Not the Verdict: Hidden Costs of Reading LLM Judges Without Generating"
Coverage timeline
- Oct 2, 04:00 UTC arXiv cs.CL lead source The First Token Is Not the Verdict: Hidden Costs of Reading LLM Judges Without Generating