SkillEval analyzes LLM ability profiles by skill using cognitive diagnosis models
Read the original at arxiv.org→arXiv:2610.28767v1 Announce Type: new Abstract: Current evaluation of LLMs on benchmarks typically aggregates performance over individual examples into a single scalar score. This approach is overly coarse and...
Original headline: "SkillEval: Learning Interpretable Ability Profiles of LLMs via Cognitive Diagnosis Models"
Coverage timeline
- Oct 22, 04:00 UTC arXiv cs.CL lead source SkillEval: Learning Interpretable Ability Profiles of LLMs via Cognitive Diagnosis Models