Modeling human cognitive processes in dynamic decision-making tasks has been an endeavor in AI for a long time because such models can help make AI systems more intuitive, personalized, mitigate any human biases, and enhance training in simulation. Some initial work has attempted to utilize neural networks (and large language models) but often assumes one common model for all humans and aims to emulate human behavior in aggregate. However, the behavior of each human is distinct, heterogeneous, and relies on specific past experiences in certain tasks. For instance, consider two individuals responding to a phishing email: one who has previously encountered and identified similar threats may recognize it quickly, while another without such experience might fall for the scam. In this work, we build on Instance Based Learning (IBL) that posits that human decisions are based on similar situations encountered in the past. However, IBL relies on simple fixed form functions to capture the mapping from past situations to current decisions. To that end, we propose two new attention-based neural network models to have open form non-linear functions to model distinct and heterogeneous human decision-making in dynamic settings. We experiment with two distinct datasets gathered from human subject experiment data, one focusing on detection of phishing email by humans and another where humans act as attackers in a cybersecurity setting and decide on an attack option. We conducted extensive experiments with our two neural network models, IBL, and GPT3.5, and demonstrate that the neural network models outperform IBL significantly in representing human decision-making, while providing similar interpretability of human decisions as IBL. Overall, our work yields promising results for further use of neural networks in cognitive modeling of human decision making.
Cognitive Models as Simulators: The Case of Moral Decision-Making
McGill University(麦吉尔大学);Université de Montréal(蒙特利尔大学);Mila - Quebec AI Institute(米拉-魁北克人工智能研究所)
为了实现理想的性能,当前的AI系统通常需要大量的训练数据。这在收集数据既昂贵又耗时的领域中尤其成问题,例如,人工智能系统需要与人类进行多次互动,收集他们的反馈。在这项工作中,我们证实了$\textit{cognitive models as simulators}$的想法,即让人工智能系统与认知模型而不是人类进行交互并从其收集反馈,从而使其训练过程成本更低,速度更快。在这里,我们在道德决策的背景下利用这个想法,通过让强化学习(RL)代理通过与最后通牒游戏(UG)的认知模型交互来学习公平性,这是行为和脑科学中研究公平性的一个典型任务。有趣的是,这些RL代理学会根据模拟UG响应者的情绪状态合理地调整他们的行为。我们的工作表明,使用认知模型作为人类的模拟器是训练AI系统的有效方法,为计算认知科学为AI做出贡献提供了重要途径。
Flipping Minds by Flipping Bits: Decision-Level Cognitive Hijacking of Large Language Models
Information Engineering University(信息工程大学);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);State Key Laboratory of Information Security, Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所信息安全国家重点实验室)
Beyond Adoption Intention How Trust in Augmented Analytics Relates to Perceived Decision Quality Among Non-Technical BI Users
British International School Ho Chi Minh City, Vietnam(越南河内国际学校);Truong Thanh Viet Nam Group, Vietnam(越南Truong Thanh Viet Nam集团);Hanoi College of Industry and Trade, Vietnam(越南河内工业贸易学院);University of Languages and International Studies, Ha Noi, Vietnam(越南河内语言与国际研究大学)
CHARMS: A Cognitive Hierarchical Agent for Reasoning and Motion Stylization in Autonomous Driving
School of Mechanical and Electronic Engineering, Wuhan University of Technology(武汉理工大学机械与电子工程学院);Intelligent Transportation Systems Research Center, Wuhan University of Technology(武汉理工大学智能交通系统研究所);Department of Data and Systems Engineering, The University of Hong Kong(香港大学数据与系统工程系);School of Computer Science and Artificial Intelligence, Wuhan University of Technology(武汉理工大学计算机科学与人工智能学院);School of Mechanical Engineering, Southeast University(东南大学机械工程学院)