Crowdsourcing can identify high-quality solutions to problems; however, individual decisions are constrained by cognitive biases. We investigate some of these biases in an experimental model of a question-answering system. In both natural and controlled experiments, we observe a strong position bias in favor of answers appearing earlier in a list of choices. This effect is enhanced by three cognitive factors: the attention an answer receives, its perceived popularity, and cognitive load, measured by the number of choices a user has to process. While separately weak, these effects synergistically amplify position bias and decouple user choices of best answers from their intrinsic quality. We end our paper by discussing the novel ways we can apply these findings to substantially improve how high-quality answers are found in question-answering systems.
Is General-Purpose AI Reasoning Sensitive to Data-Induced Cognitive Biases? Dynamic Benchmarking on Typical Software Engineering Dilemmas
Collegium Helveticum, ETH Zurich(瑞士苏黎世联邦理工学院);University of Zurich(苏黎世大学);University of Italian-speaking Switzerland(意大利语瑞士大学);ETH Zurich(苏黎世联邦理工学院);University of Bologna(博洛尼亚大学)
Feasibility of Detecting Cognitive Impairment and Psychological Well-being among Older Adults Using Facial, Acoustic, Linguistic, and Cardiovascular Patterns Derived from Remote Conversations
Department of Computer Science, Emory University(计算机科学系,埃默里大学);The Wallace H. Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology(生物医学工程系,埃默里大学和佐治亚理工学院);Department of Systems and Biomedical Engineering, Cairo University(系统与生物医学工程系,开罗大学);Department of Biomedical Informatics, Emory University(生物医学信息学系,埃默里大学);Department of Neurology, Massachusetts General Hospital, Harvard Medical School(神经病学系,麻省总医院,哈佛医学院);Department of Psychiatry and Behavioral Sciences, Emory University(精神病学与行为科学系,埃默里大学)
Shaping Opinion: Quantifying the Psychological Impact of Autonomous Multi-Agent LLM Interactions
Universidad de La Laguna(拉各纳大学);French National Centre for Scientific Research (CNRS)(法国国家科学研究中心);Toulouse Institute of Computer Science Research (IRIT)(图卢兹计算机科学研究所以);Centre for European Policy Studies(欧洲政策研究中心)
A Predictive Model of Digital Information Engagement: Forecasting User Engagement With English Words by Incorporating Cognitive Biases, Computational Linguistics and Natural Language Processing
State University of New York at Albany(纽约州立大学奥尔巴尼分校);Google(谷歌公司)