Verbalized confidence becomes a more robust soft-scoring signal than log-probabilities for LLM-as-a-Judge on post-2025 proprietary models; the authors term this a compatibility shift.
Read the original at arxiv.org→arXiv:2609.10996v1 Announce Type: new Abstract: Verbalized confidence, long dismissed as overconfident, coarse, and prone to round-number clustering, is now the more robust soft-scoring mechanism for LLM-as-a-Judge...
Original headline: "Rethinking Verbalized Confidence for LLM-as-a-Judge: A Compatibility Shift on Post-2025 Proprietary Models"
Coverage timeline
- Sep 11, 04:00 UTC arXiv cs.CL lead source Rethinking Verbalized Confidence for LLM-as-a-Judge: A Compatibility Shift on Post-2025 Proprietary Models