As AI agents increasingly operate in multi-agent environments, understanding their collective behavior becomes critical for predicting the dynamics of artificial societies. This study examines conformity, the tendency to align with group opinions under social pressure, in large multimodal language models functioning as AI agents. By adapting classic visual experiments from social psychology, we investigate how AI agents respond to group influence as social actors. Our experiments reveal that AI agents exhibit a systematic conformity bias, aligned with Social Impact Theory, showing sensitivity to group size, unanimity, task difficulty, and source characteristics. Critically, AI agents achieving near-perfect performance in isolation become highly susceptible to manipulation through social influence. This vulnerability persists across model scales: while larger models show reduced conformity on simple tasks due to improved capabilities, they remain vulnerable when operating at their competence boundary. These findings reveal fundamental security vulnerabilities in AI agent decision-making that could enable malicious manipulation, misinformation campaigns, and bias propagation in multi-agent systems, highlighting the urgent need for safeguards in collective AI deployments.
LLMs Can't Handle Peer Pressure: Crumbling under Multi-Agent Social Interactions
Singapore University of Technology and Design(新加坡科技设计大学);Nanyang Technological University(南洋理工大学);National University of Singapore(国立新加坡大学);Lambda Labs(Lambda实验室)
Reddit-Impacts: A Named Entity Recognition Dataset for Analyzing Clinical and Social Effects of Substance Use Derived from Social Media
Emory University(埃默里大学);University of Pennsylvania(宾夕法尼亚大学);Vanderbilt University Medical Center(范德堡大学医学中心);Cedars-Sinai Medical Center(西达赛奈医疗中心);Georgia Institute of Technology(佐治亚理工学院)
Social Science Is Necessary for Operationalizing Socially Responsible Foundation Models
Siebel School of Computing and Data Science(西贝尔计算与数据科学学院);The Grainger College of Engineering(格兰杰工程学院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Tübingen AI Center(蒂宾根人工智能中心);University of Tübingen(蒂宾根大学);School of Complex Adaptive Systems(复杂适应系统学院);Arizona State University(亚利桑那州立大学);School for the Future of Innovation in Society(社会创新未来学院)