arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2004.02289cs.LGcs.AIcs.HC
收藏

人类-人工智能团队中的个性化:提高可靠性-准确性权衡

Personalization in Human-AI Teams: Improving the Compatibility-Accuracy Tradeoff

Ben-Gurion University(本-古里安大学);Microsoft Research(微软研究院);Amii, University of Alberta(阿尔伯塔机器智能研究所,阿尔伯塔大学)

Jonathan Martinez, Kobi Gal, Ece Kamar, Levi H. S. Lelis

摘要:

建模并与用户交互的人工智能系统可以随着时间的推移更新模型,以反映环境中的新信息和变化。虽然这些更新可能会提高AI系统的整体性能,但实际上可能会损害单个用户的性能。先前的工作已经研究了在更新之后提高系统的准确性与更新后的系统与先前的用户体验的兼容性之间的权衡。模型越是被迫与先前版本兼容,其准确性损失就越大。在本文中,我们表明,通过针对特定用户对损失函数进行个性化,在某些情况下,可以改善这些用户的兼容性-准确性权衡(增加模型的兼容性,同时牺牲较少的准确性)。我们目前的实验结果表明,这种方法提供了适度的改善平均(约20%),但大的改善某些用户(高达300%)。

英文摘要:

AI systems that model and interact with users can update their models over time to reflect new information and changes in the environment. Although these updates may improve the overall performance of the AI system, they may actually hurt the performance with respect to individual users. Prior work has studied the trade-off between improving the system's accuracy following an update and the compatibility of the updated system with prior user experience. The more the model is forced to be compatible with a prior version, the higher loss in accuracy it will incur. In this paper, we show that by personalizing the loss function to specific users, in some cases it is possible to improve the compatibility-accuracy trade-off with respect to these users (increase the compatibility of the model while sacrificing less accuracy). We present experimental results indicating that this approach provides moderate improvements on average (around 20%) but large improvements for certain users (up to 300%).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑