We explored cultural biases-individualism vs. collectivism-in ChatGPT across three Western languages (i.e., English, German, and French) and three Eastern languages (i.e., Chinese, Japanese, and Korean). When ChatGPT adopted an individualistic persona in Western languages, its collectivism scores (i.e., out-group values) exhibited a more negative trend, surpassing their positive orientation towards individualism (i.e., in-group values). Conversely, when a collectivistic persona was assigned to ChatGPT in Eastern languages, a similar pattern emerged with more negative responses toward individualism (i.e., out-group values) as compared to collectivism (i.e., in-group values). The results indicate that when imbued with a particular social identity, ChatGPT discerns in-group and out-group, embracing in-group values while eschewing out-group values. Notably, the negativity towards the out-group, from which prejudices and discrimination arise, exceeded the positivity towards the in-group. The experiment was replicated in the political domain, and the results remained consistent. Furthermore, this replication unveiled an intrinsic Democratic bias in Large Language Models (LLMs), aligning with earlier findings and providing integral insights into mitigating such bias through prompt engineering. Extensive robustness checks were performed using varying hyperparameter and persona setup methods, with or without social identity labels, across other popular language models.
Mitigating Strategy Preference Bias in Emotional Support Conversation via Uncertainty Estimations
Shanghai Institute of Artificial Intelligence for Education(上海人工智能教育研究院);School of Computer Science and Technology(计算机科学与技术学院);School of Psychology and Cognitive Science(心理学与认知科学学院);School of Pharmacy(药学院)
Multi-Persona Thinking for Bias Mitigation in Large Language Models
Dept. Computing Science, Alberta Machine Intelligence Institute (Amii) University of Alberta, Canada(计算科学系,阿尔伯塔机器智能研究所(Amii),阿尔伯塔大学,加拿大);Canada CIFAR AI Chair, Amii(加拿大 CIFAR 人工智能主席,Amii)
How Large Language Models Get Stuck: Early structure with persistent errors
Department of Statistics(统计学系);University of Connecticut, Storrs(康涅狄格大学斯托尔分校);Department of Linguistics(语言学系);Department of Psychological Sciences(心理学科学系)
The Biased Samaritan: LLM biases in Perceived Kindness
Department of Cognitive Science University of California, Davis(认知科学系加州大学戴维斯分校);Department of Statistics University of California, Davis(统计学系加州大学戴维斯分校);Department of Computer Science University of California, Davis(计算机科学系加州大学戴维斯分校)
Assumed Identities: Quantifying Gender Bias in Machine Translation of Gender-Ambiguous Occupational Terms
School of Electrical and Computer Engineering, National Technical University of Athens(电气与计算机工程学院,国家技术大学雅典);Instituto de Telecomunicações(电信研究所);Department of Social Policy, Panteion University of Social and Political Sciences(社会政策系,帕内翁社会与政治科学大学)
Laissez-Faire Harms: Algorithmic Biases in Generative Language Models
Young Data Scientists League(年轻数据科学家联盟);Stanford University(斯坦福大学);Georgia Institute of Technology(佐治亚理工学院);Schar School of Policy and Government & Department of Computer Science(政策与政府学院及计算机科学系);George Mason University(乔治·马歇尔大学)
A Study on Bias Detection and Classification in Natural Language Processing
Instituto Superior Técnico, Universidade de Lisboa(里斯本大学高等技术学院);INESC-ID(INESC-ID研究所);Unbabel(Unbabel公司);Faculdade de Letras, Universidade de Lisboa(里斯本大学文学院)
Rnn-transducer with language bias for end-to-end Mandarin-English code-switching speech recognition
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);CAS Center for Excellence in Brain Science and Intelligence Technology(中国科学院脑科学与智能技术卓越创新中心)