arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2204.10940cs.LG
收藏

使用多个黑箱模型平衡情感检测的公平性和准确性

Balancing Fairness and Accuracy in Sentiment Detection using Multiple Black Box Models

Rutgers University(罗格斯大学)

Abdulaziz A. Almuzaini, Vivek K. Singh

摘要:

情感检测是多个信息检索任务(例如产品推荐、网络欺凌检测和错误信息检测)的重要构建块。不出所料,现在有多种商业API可用于情感检测,每种API都具有不同的准确性和公平性。虽然在多媒体计算文献中通常研究从多个模态或黑盒模型中组合输入以提高准确性,但是在组合不同模态以提高所得到的决策的公平性方面的工作很少。在这项工作中,我们审计了两个演员新闻标题设置中的性别偏见的多个商业情感检测API,并报告了观察到的偏见水平。接下来,我们提出了一种“灵活的公平回归”方法,该方法通过从多个黑盒模型中联合学习来确保令人满意的准确性和公平性。这些结果为多个应用程序的公平而准确的情感检测器铺平了道路。

英文摘要:

Sentiment detection is an important building block for multiple information retrieval tasks such as product recommendation, cyberbullying detection, and misinformation detection. Unsurprisingly, multiple commercial APIs, each with different levels of accuracy and fairness, are now available for sentiment detection. While combining inputs from multiple modalities or black-box models for increasing accuracy is commonly studied in multimedia computing literature, there has been little work on combining different modalities for increasing fairness of the resulting decision. In this work, we audit multiple commercial sentiment detection APIs for the gender bias in two actor news headlines settings and report on the level of bias observed. Next, we propose a "Flexible Fair Regression" approach, which ensures satisfactory accuracy and fairness by jointly learning from multiple black-box models. The results pave way for fair yet accurate sentiment detectors for multiple applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑