CulturalCrosswords: a multilingual benchmark testing how answer constraints affect LLMs solving cultural riddles across 53 crosswords in 42 languages
Read the original at arxiv.org→arXiv:2611.10044v1 Announce Type: new Abstract: When several answers fit a riddle, exact-match scoring can penalise a valid response. CulturalCrosswords tests how answer constraints affect large language models...
Original headline: "CulturalCrosswords: A Multilingual Benchmark comprised of Answer Constraints and Grid Completion"
Coverage timeline
- Nov 10, 05:00 UTC arXiv cs.CL lead source CulturalCrosswords: A Multilingual Benchmark comprised of Answer Constraints and Grid Completion