Artificial Intelligence (AI) is increasingly used to build Decision Support Systems (DSS) across many domains. This paper describes a series of experiments designed to observe human response to different characteristics of a DSS such as accuracy and bias, particularly the extent to which participants rely on the DSS, and the performance they achieve. In our experiments, participants play a simple online game inspired by so-called "wildcat" (i.e., exploratory) drilling for oil. The landscape has two layers: a visible layer describing the costs (terrain), and a hidden layer describing the reward (oil yield). Participants in the control group play the game without receiving any assistance, while in treatment groups they are assisted by a DSS suggesting places to drill. For certain treatments, the DSS does not consider costs, but only rewards, which introduces a bias that is observable by users. Between subjects, we vary the accuracy and bias of the DSS, and observe the participants' total score, time to completion, the extent to which they follow or ignore suggestions. We also measure the acceptability of the DSS in an exit survey. Our results show that participants tend to score better with the DSS, that the score increase is due to users following the DSS advice, and related to the difficulty of the game and the accuracy of the DSS. We observe that this setting elicits mostly rational behavior from participants, who place a moderate amount of trust in the DSS and show neither algorithmic aversion (under-reliance) nor automation bias (over-reliance).However, their stated willingness to accept the DSS in the exit survey seems less sensitive to the accuracy of the DSS than their behavior, suggesting that users are only partially aware of the (lack of) accuracy of the DSS.
When Bias Backfires: The Modulatory Role of Counterfactual Explanations on the Adoption of Algorithmic Bias in XAI-Supported Human Decision-Making
Machine Learning Group, Bielefeld University(比勒菲尔德大学机器学习组);Research Center Trustworthy Data Science and Security of the University Alliance Ruhr, Faculty of Informatics, Technical University Dortmund(鲁尔大学联盟可信数据科学与安全研究所以及多特蒙德技术大学信息学院)
Department of Statistics, University of Washington(华盛顿大学统计学系);Department of Computer Science, University of Washington(华盛顿大学计算机科学系);Dallas, Texas(德克萨斯州达拉斯);Department of Computer Science, Stanford University(斯坦福大学计算机科学系);Psychiatry and Behavioral Science, University of Washington(华盛顿大学精神病学与行为科学系);Department of Communication, Stanford University(斯坦福大学传播学系)
Definition drives design: Disability models and mechanisms of bias in AI technologies
University of Sheffield(谢菲尔德大学);University of Pittsburgh(匹兹堡大学);McMaster University(麦克马斯特大学);University of Michigan(密歇根大学);University of Cambridge(剑桥大学)
AIM-Bench: Evaluating Decision-making Biases of Agentic LLM as Inventory Manager
School of Management and Engineering, Nanjing University(南京大学管理工程学院);School of Robotics and Automation, Nanjing University (Suzhou Campus)(南京大学机器人与自动化学院)
A Broader View on Bias in Automated Decision-Making: Reflecting on Epistemology and Dynamics
Department of Electrical Engineering and Computer Sciences, University of California Berkeley, USA(加州大学伯克利分校电气工程与计算机科学系);Department of Rhetoric, University of California Berkeley, USA(加州大学伯克利分校修辞学系);School of Information, University of California Berkeley, USA(加州大学伯克利分校信息学院)
Inferring response times of perceptual decisions with Poisson variational autoencoders
VIB–Neuroelectronics Research Flanders(VIB神经电子研究佛兰德斯);KU Leuven(库尔勒大学);Herbert Wertheim School of Optometry & Vision Science, UC Berkeley(赫伯特·韦尔泰姆视觉科学学院,伯克利大学);Redwood Center for Theoretical Neuroscience, UC Berkeley(红木理论神经科学中心,伯克利大学)
Large Language Newsvendor: Decision Biases and Cognitive Mechanisms
School of Business Administration, South China University of Technology(华南理工大学商学院);Department of Decisions, Operations and Technology, The Chinese University of Hong Kong(香港中文大学决策、运营与技术系)
When Names Change Verdicts: Intervention Consistency Reveals Systematic Bias in LLM Decision-Making
Indian Institute of Information Technology, Allahabad (IIITA)(印度阿勒颇理工学院,阿勒颇(IIITA));National Institute of Electronics and Information Technology (NIELIT)(国家电子与信息技术研究所(NIELIT))
Rutgers University(罗格斯大学);University of Pittsburgh(匹兹堡大学);Korea University(高丽大学);Korean National Police University(韩国警察大学);Ewha Womans University(梨花女子大学)
Can Induced Emotion Bias LLM Behaviors in Sequential Decision Making?
MBZUAI(穆罕默德·本·扎耶德人工智能大学);Texas A&M University(德州农工大学);National University of Singapore(新加坡国立大学);UCLA(加州大学洛杉矶分校);University of Texas at Austin(德克萨斯大学奥斯汀分校);Mass General Hospital(麻省总医院);Harvard Medical School(哈佛医学院)