When F1 is not enough: auditing codebooks for LLM-assisted annotation
Read the original at arxiv.org→arXiv:2611.08846v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for text annotation in social science, but standard performance metrics do not explain why errors occur. Low F1 may...
Original headline: "When F1 Is Not Enough: Auditing Codebooks for LLM-Assisted Annotation"
Coverage timeline
- Nov 9, 05:00 UTC arXiv cs.AI lead source When F1 Is Not Enough: Auditing Codebooks for LLM-Assisted Annotation