Given the rapid advancement of large-scale language models, artificial intelligence (AI) models, like ChatGPT, are playing an increasingly prominent role in human society. However, to ensure that artificial intelligence models benefit human society, we must first fully understand the similarities and differences between the human-like characteristics exhibited by artificial intelligence models and real humans, as well as the cultural stereotypes and biases that artificial intelligence models may exhibit in the process of interacting with humans. This study first measured ChatGPT in 84 dimensions of psychological characteristics, revealing differences between ChatGPT and human norms in most dimensions as well as in high-dimensional psychological representations. Additionally, through the measurement of ChatGPT in 13 dimensions of cultural values, it was revealed that ChatGPT's cultural value patterns are dissimilar to those of various countries/regions worldwide. Finally, an analysis of ChatGPT's performance in eight decision-making tasks involving interactions with humans from different countries/regions revealed that ChatGPT exhibits clear cultural stereotypes in most decision-making tasks and shows significant cultural bias in third-party punishment and ultimatum games. The findings indicate that, compared to humans, ChatGPT exhibits a distinct psychological profile and cultural value orientation, and it also shows cultural biases and stereotypes in interpersonal decision-making. Future research endeavors should emphasize enhanced technical oversight and augmented transparency in the database and algorithmic training procedures to foster more efficient cross-cultural communication and mitigate social disparities.
Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Study
Huazhong University of Science and Technology(华中科技大学);University of Copenhagen(哥本哈根大学);University of Electronic Science and Technology of China(电子科技大学);Technical University of Darmstadt(达姆施塔特工业大学);South China University of Technology(华南理工大学)
Who is ChatGPT? Benchmarking LLMs' Psychological Portrayal Using PsychoBench
The Chinese University of Hong Kong(香港中文大学);Tianjin Medical University(天津医科大学);Tencent AI Lab(腾讯AI实验室);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
The Cultural Psychology of Large Language Models: Is ChatGPT a Holistic or Analytic Thinker?
New York University(纽约大学);University of Chicago(芝加哥大学);Massachusetts Institute of Technology(麻省理工学院);Johns Hopkins University(约翰斯·霍普金斯大学);University of California Los Angeles(加州大学洛杉矶分校)
Supervised Semantic Differential for Cross-Cultural Concept Analysis: A Case Study of Human Affect
University of Warsaw(华沙大学);Society for Open Science(开放科学协会);Centre for Brain Research, Jagiellonian University(雅盖隆大学脑研究中心);IDEAS Research Institute(IDEAS研究院)
How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection
Xidian University(西安电子科技大学);Queen’s University(女王大学);Wind Information Co., Ltd(万得信息股份有限公司);Shanghai University of Finance and Economics(上海财经大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Beijing Language and Culture University(北京语言大学)
What does ChatGPT return about human values? Exploring value bias in ChatGPT using a descriptive value theory
Institute D’Or for Research and Teaching(多尔研究与教学学院);School of Psychology(心理学院);School of Information Management(信息管理学院);Dublin City University(都柏林城市大学);University of Western Australia(西澳大学)
本研究基于 Schwartz 基础价值观理论,通过 OpenAI API 重复提示 ChatGPT 生成文本并使用词袋方法分析,发现其输出无明显价值偏见且高保真传递了价值内容,仅存在社会导向价值观的融合。
ELLIS Alicante(阿利坎特ELLIS);University of South Bohemia(南波希米亚大学);Czech Institute of Informatics, Robotics, and Cybernetics, CTU in Prague(布拉格捷克理工大学捷克信息学、机器人与控制论研究所)
Beyond Demographics: Enhancing Cultural Value Survey Simulation with Multi-Stage Personality-Driven Cognitive Reasoning
School of Computer Science and Technology, Wuhan University of Science and Technology(武汉科技大学计算机科学与技术学院);Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan University of Science and Technology(湖北省智能信息处理与实时工业系统重点实验室);Innovation, Policy and Entrepreneurship Thrust, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)创新、政策与创业方向);Tübingen AI Center, University of Tübingen(图宾根大学图宾根人工智能中心);Department of Computer Science, University of Copenhagen(哥本哈根大学计算机科学系)
Empirical evidence of Large Language Model's influence on human spoken communication
Center for Humans and Machines(人类与机器中心);Max-Planck Institute for Human Development(人类发展马克斯·普朗克研究所);Center for Adaptive Rationality(适应性理性中心);TUD Dresden University of Technology(德累斯顿技术大学);Department of Business Analytics and Decision Science(商业分析与决策科学系);Vienna University of Economics and Business(维也纳经济与商业大学)
Exploring LGBTQ+ Bias in Generative AI Answers across Different Country and Religious Contexts
Corvinus University of Budapest(布达佩斯考文纽斯大学);Central European University Democracy Institute(中欧大学民主研究所);University of British Columbia Okanagan(不列颠哥伦比亚大学奥肯那根分校);HUN-REN Centre for Social Sciences(匈牙利研究网络社会科学中心)