Embedding-based measurement of data diversity for NLP; emb-diversity tool assesses diversity using embeddings

arXiv:2607.19848v1 Announce Type: new Abstract: There is growing evidence that data diversity is crucial for developing fair and robust NLP models. However, current approaches to measure diversity remain...