arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.07571cs.CL

Toward Deconfounding the Influence of Entity Demographics for Question Answering Accuracy

Google Research(谷歌研究院);University of Maryland(马里兰大学)

Maharshi Gor, Kellie Webster, Jordan Boyd-Graber

英文摘要:

The goal of question answering (QA) is to answer any question. However, major QA datasets have skewed distributions over gender, profession, and nationality. Despite that skew, model accuracy analysis reveals little evidence that accuracy is lower for people based on gender or nationality; instead, there is more variation on professions (question topic). But QA's lack of representation could itself hide evidence of bias, necessitating QA datasets that better represent global diversity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑