Romanized Indic generation misrepresented by automatic metrics; four LLMs evaluated on Hindi, Telugu, and Kannada demonstrate gaps in evaluation
Read the original at arxiv.org→arXiv:2611.09085v1 Announce Type: new Abstract: Hundreds of millions of Indians communicate with digital systems in romanized Latin characters -- typing "aap kaise hain" rather than native script -- yet romanized...
Original headline: "The Invisible Gap: Romanized Indic Generation Fails Where Automatic Metrics Succeed"
Coverage timeline
- Nov 9, 05:00 UTC arXiv cs.CL lead source The Invisible Gap: Romanized Indic Generation Fails Where Automatic Metrics Succeed