arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.12043cs.CL
收藏

When do Word Embeddings Accurately Reflect Surveys on our Beliefs About People?

University at Buffalo(布法罗大学);Fachhochschule Potsdam(波茨坦应用技术大学)

Kenneth Joseph, Jonathan H. Morgan

英文摘要:

Social biases are encoded in word embeddings. This presents a unique opportunity to study society historically and at scale, and a unique danger when embeddings are used in downstream applications. Here, we investigate the extent to which publicly-available word embeddings accurately reflect beliefs about certain kinds of people as measured via traditional survey methods. We find that biases found in word embeddings do, on average, closely mirror survey data across seventeen dimensions of social meaning. However, we also find that biases in embeddings are much more reflective of survey data for some dimensions of meaning (e.g. gender) than others (e.g. race), and that we can be highly confident that embedding-based measures reflect survey data only for the most salient biases.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑