PersEvalBench tests whether LLM evaluators can recognize appropriate and inappropriate uses of user history
Read the original at arxiv.org→arXiv:2610.19314v1 Announce Type: new Abstract: Large language model (LLM) evaluators are increasingly used to assess personalized assistants, yet whether they can reliably judge personalization has rarely been...
Original headline: "PersEvalBench: Can LLM Evaluators Judge Contextually Appropriate Use of Persona Information?"
Coverage timeline
- Oct 15, 04:00 UTC arXiv cs.CL lead source PersEvalBench: Can LLM Evaluators Judge Contextually Appropriate Use of Persona Information?