arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2501.12868cs.HCcs.AI

信心相辅:探索AI信心对人类自信心在人类-AI决策中的影响

As Confidence Aligns: Exploring the Effect of AI Confidence on Human Self-confidence in Human-AI Decision Making

National University of Singapore(新加坡国立大学);Microsoft Research(微软研究院)

Jingshu Li, Yitian Yang, Q. Vera Liao, Junti Zhang, Yi-Chieh Lee

AI总结:

本研究发现人类自信心与AI置信度相辅相成,且这种一致性在AI退出后仍持续,同时实时反馈会降低一致性,表明两者并非独立。

摘要:

在人类-人工智能决策中,人类与人工智能之间的互补协作至关重要。一种可行的方法是考虑人工智能和用户校准的置信度水平。然而,这一过程可能会因人工智能的置信度可能影响用户的自信心及其校准而变得更加困难。为了探索这些动态,我们进行了随机行为实验。我们的结果表明,在人类-人工智能决策中,用户的自信心与人工智能的置信度相辅相成,即使人工智能不再参与,这种一致性仍能持续。这种一致性随后影响用户的自信心校准。我们还发现,决策的实时正确性反馈减少了这种一致性程度。这些发现表明,用户的自信心并不独立于人工智能的置信度,这对旨在实现更好人类-人工智能协作的实践者来说需要引起注意。我们呼吁研究人类认知和行为与人工智能的一致性。

英文摘要:

Complementary collaboration between humans and AI is essential for human-AI decision making. One feasible approach to achieving it involves accounting for the calibrated confidence levels of both AI and users. However, this process would likely be made more difficult by the fact that AI confidence may influence users' self-confidence and its calibration. To explore these dynamics, we conducted a randomized behavioral experiment. Our results indicate that in human-AI decision-making, users' self-confidence aligns with AI confidence and such alignment can persist even after AI ceases to be involved. This alignment then affects users' self-confidence calibration. We also found the presence of real-time correctness feedback of decisions reduced the degree of alignment. These findings suggest that users' self-confidence is not independent of AI confidence, which practitioners aiming to achieve better human-AI collaboration need to be aware of. We call for research focusing on the alignment of human cognition and behavior with AI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑