Better Retrievers, Worse Labels: Incomplete relevance judgments distort abstention evaluation in conversational RAG
Read the original at arxiv.org→arXiv:2610.40966v1 Announce Type: new Abstract: Conversational RAG benchmarks such as MTRAG and RETECO evaluate retrieval and generation end to end: each system answers from its own retrieval, so abstention must be...
Original headline: "Better Retrievers, Worse Labels: How Incomplete Relevance Judgments Distort Abstention Evaluation in Conversational RAG"
Coverage timeline
- Nov 2, 05:00 UTC arXiv cs.CL lead source Better Retrievers, Worse Labels: How Incomplete Relevance Judgments Distort Abstention Evaluation in Conversational RAG