As Natural Language Processing (NLP) systems are increasingly employed in intricate social environments, a pressing query emerges: Can these NLP systems mirror human-esque collaborative intelligence, in a multi-agent society consisting of multiple large language models (LLMs)? This paper probes the collaboration mechanisms among contemporary NLP systems by melding practical experiments with theoretical insights. We fabricate four unique `societies' comprised of LLM agents, where each agent is characterized by a specific `trait' (easy-going or overconfident) and engages in collaboration with a distinct `thinking pattern' (debate or reflection). Through evaluating these multi-agent societies on three benchmark datasets, we discern that certain collaborative strategies not only outshine previous top-tier approaches, but also optimize efficiency (using fewer API tokens). Moreover, our results further illustrate that LLM agents manifest human-like social behaviors, such as conformity and consensus reaching, mirroring foundational social psychology theories. In conclusion, we integrate insights from social psychology to contextualize the collaboration of LLM agents, inspiring further investigations into the collaboration mechanism for LLMs. We commit to sharing our code and datasets\footnote{\url{https://github.com/zjunlp/MachineSoM}.}, hoping to catalyze further research in this promising avenue.
Exploring the psychology of LLMs' Moral and Legal Reasoning
INSPER Institute of Education and Research(INSPER 教育与研究学院);FGV Direito Rio(FGV 里约法学院);PUC-Rio(里约热内卢天主教大学);Center for Humans and Machines, Max Planck Institute for Human Development(马克斯·普朗克人类发展研究所人类与机器中心);Ruhr-University Bochum(波鸿鲁尔大学);Federal University of Rio de Janeiro(里约热内卢联邦大学);State University of Rio de Janeiro(里约热内卢州立大学)
The Incomplete Bridge: How AI Research (Mis)Engages with Psychology
Department of Computer Science, Johns Hopkins University(约翰霍普金斯大学计算机科学系);Microsoft Research Asia(微软亚洲研究院);Department of Psychological Sciences, Rice University(里士满大学心理学科学系)
From Visual Perception to Deep Empathy: An Automated Assessment Framework for House-Tree-Person Drawings Using Multimodal LLMs and Multi-Agent Collaboration
Tsinghua University(清华大学);Shenzhen University(深圳大学);University of Oxford(牛津大学);Shenzhen Institute of Education Sciences(深圳市教育科学研究院);Guangzhou University of Chinese Medicine(广州中医药大学);Harbin Institute of Technology(哈尔滨工业大学)
When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment
MPI(马克斯·普朗克研究所);ETH Zürich(苏黎世联邦理工学院);MIT(麻省理工学院);Harvard(哈佛大学);IIT Kharagpur(印度理工学院卡拉格普尔分校);Carnegie Mellon University(卡内基梅隆大学);University of Michigan(密歇根大学);MPI for Intelligent Systems(马克斯·普朗克智能系统研究所)
RAM2C: A Liberal Arts Educational Chatbot based on Retrieval-augmented Multi-role Multi-expert Collaboration
Center for Brain Inspired Computing Research (CBICR), Tsinghua University(清华大学脑启发计算研究中心);Optical Memory National Engineering Research Center, Tsinghua University(清华大学光存储国家工程研究中心);Tsinghua University-China Electronics Technology HIK Group Co. Joint Research Center for Brain-inspired Computing(清华大学-中国电子 hik 集团联合脑启发计算研究中心);IDG/McGovern Institute for Brain Research, Tsinghua University(清华大学 IDG/麦戈文脑科学研究院);Tsinghua University(清华大学)
Text Production and Comprehension by Human and Artificial Intelligence: Interdisciplinary Workshop Report
Nottingham Trent University(诺丁汉特伦特大学);Cornell University(康奈尔大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of the Saarland(萨尔大学);University of Texas at Austin(德克萨斯大学奥斯汀分校);University of Edinburgh(爱丁堡大学);Tuebingen University(图宾根大学);Montclair State University(蒙特克莱尔州立大学);Carnegie Mellon University(卡内基梅隆大学);Georgia Institute of Technology(佐治亚理工学院);Iowa State University(爱荷华州立大学);Embry-Riddle Aeronautical University(安柏瑞德航空航天大学);Midland University(米德兰大学);University of Chicago(芝加哥大学);University of Iowa(爱荷华大学)
When LLMs Team Up: The Emergence of Collaborative Affective Computing
Department of Computing, Hong Kong Polytechnic University(香港理工大学计算机系);School of Data Science, Lingnan University(岭南大学数据科学学院);School of Computer Science and the Data Science Institute, University of Technology Sydney(悉尼大学计算机科学学院和数据科学研究所);Education University of Hong Kong(香港教育大学)
PhenoFlow: A Human-LLM Driven Visual Analytics System for Exploring Large and Complex Stroke Datasets
Seoul National University(首尔大学);Korea University Guro Hospital(高丽大学九老医院);Seoul National University College of Medicine(首尔大学医学院);Seoul National University Bundang Hospital(首尔大学盆唐医院);Hankuk University of Foreign Studies(韩国外国语大学)
Exploring the Impact of Personality Traits on LLM Bias and Toxicity
University of Macau(澳门大学);Shenzhen Key Laboratory for High Performance Data Mining, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(深圳高性能数据挖掘重点实验室,深圳先进技术研究院,中国科学院);Nanyang Technological University(南洋理工大学);Department of Chinese Language and Literature, University of Macau(中文语言文学系,澳门大学)
Large Language Model-based Human-Agent Collaboration for Complex Task Solving
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
BERT meets LIWC: Exploring State-of-the-Art Language Models for Predicting Communication Behavior in Couples' Conflict Interactions
University of Surrey(萨里大学);ETH Zurich(苏黎世联邦理工学院);University of Lausanne(洛桑大学);University of Zurich(苏黎世大学);University of Konstanz(康斯坦茨大学);University of St. Gallen(圣加仑大学)