arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.09281cs.AI
收藏

预测与理解人类行动决策:来自大型语言模型与基于认知实例学习的洞见

Predicting and Understanding Human Action Decisions: Insights from Large Language Models and Cognitive Instance-Based Learning

University of Dayton(代顿大学);Carnegie Mellon University(卡内基梅隆大学)

Thuy Ngoc Nguyen, Kasturi Jamale, Cleotilde Gonzalez

AI总结:

本文比较LLMs与认知IBL模型在两个序列决策任务中预测人类行为的能力,发现LLMs反馈整合更快,而IBL更能捕捉探索行为与损失厌恶,支持二者融合建模。

摘要:

大型语言模型(LLMs)已在从语言翻译到复杂推理的各类任务中展示了其能力。理解并预测人类行为与偏差,对于人工智能(AI)辅助系统提供有用帮助至关重要,但这些模型能否实现这一点仍是一个悬而未决的问题。本文利用LLMs的推理和生成能力来预测两个序列决策任务中的人类行为,以弥补这一空白。这些任务涉及在利用性行动与探索性行动之间取得平衡,以及处理延迟反馈,二者对于模拟现实生活中的决策过程都必不可少。我们将LLMs的表现与基于认知实例学习(IBL)模型进行比较,该模型模仿人类基于经验的决策。研究结果表明,LLMs擅长快速整合反馈以提高预测准确性。相比之下,认知IBL模型能更好地解释人类的探索行为,并有效捕捉损失厌恶偏差,即倾向于选择步数成本惩罚较少的次优目标,而不是通过探索找到最优选择,即使在经验有限时也是如此。结果凸显了将LLMs与认知架构相结合的益处,表明这种协同作用可以增强对复杂人类决策模式的建模与理解。

英文摘要:

Large Language Models (LLMs) have demonstrated their capabilities across various tasks, from language translation to complex reasoning. Understanding and predicting human behavior and biases are crucial for artificial intelligence (AI) assisted systems to provide useful assistance, yet it remains an open question whether these models can achieve this. This paper addresses this gap by leveraging the reasoning and generative capabilities of the LLMs to predict human behavior in two sequential decision-making tasks. These tasks involve balancing between exploitative and exploratory actions and handling delayed feedback, both essential for simulating real-life decision processes. We compare the performance of LLMs with a cognitive instance-based learning (IBL) model, which imitates human experiential decision-making. Our findings indicate that LLMs excel at rapidly incorporating feedback to enhance prediction accuracy. In contrast, the cognitive IBL model better accounts for human exploratory behaviors and effectively captures loss aversion bias, i.e., the tendency to choose a sub-optimal goal with fewer step-cost penalties rather than exploring to find the optimal choice, even with limited experience. The results highlight the benefits of integrating LLMs with cognitive architectures, suggesting that this synergy could enhance the modeling and understanding of complex human decision-making patterns.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑