Over the last year, Large Language Models (LLMs) like ChatGPT have become widely available and have exhibited fairness issues similar to those in previous machine learning systems. Current research is primarily focused on analyzing and quantifying these biases in training data and their impact on the decisions of these models, alongside developing mitigation strategies. This research largely targets well-known biases related to gender, race, ethnicity, and language. However, it is clear that LLMs are also affected by other, less obvious implicit biases. The complex and often opaque nature of these models makes detecting such biases challenging, yet this is crucial due to their potential negative impact in various applications. In this paper, we explore new avenues for detecting these unanticipated biases in LLMs, focusing specifically on Uncertainty Quantification and Explainable AI methods. These approaches aim to assess the certainty of model decisions and to make the internal decision-making processes of LLMs more transparent, thereby identifying and understanding biases that are not immediately apparent. Through this research, we aim to contribute to the development of fairer and more transparent AI systems.
Are LLMs Rational Investors? A Study on Detecting and Reducing the Financial Bias in LLMs
School of Computer Science, Fudan University(复旦大学计算机科学技术学院);Institute of Fintech, Fudan University(复旦大学金融科技研究院);School of Electronics and Information Engineering, Tongji University(同济大学电子与信息工程学院);Tandon School of Engineering, New York University(纽约大学坦登工程学院);DataGrand Inc.(数据堂公司)
PolBiX: Detecting LLMs' Political Bias in Fact-Checking through X-phemisms
Quality & Usability Lab, Technische Universität Berlin(柏林技术大学质量与可用性实验室);German Research Center for Artificial Intelligence (DFKI), Berlin(德国人工智能研究中心(DFKI));Department of Media and Communication, Ludwig-Maximilians-Universität München(慕尼黑路德维希-马克西米利安大学媒体与传播系)
Confident, Calibrated, or Complicit: Probing the Trade-offs between Safety Alignment and Ideological Bias in Language Models in Detecting Hate Speech
School of Physics, Mathematics and Computing(物理、数学与计算学系);Network Analysis and Social Influence Modelling (NASIM) Lab(网络分析与社会影响建模实验室);The University of Western Australia(西澳大学)
Gradient Co-occurrence Analysis for Detecting Unsafe Prompts in Large Language Models
College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部);IT Innovation and Research Center, Huawei Technologies(华为技术有限公司IT创新研究中心);Artificial Intelligence Academy, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院)
IndRegBias: A Dataset for Studying Indian Regional Biases in English and Code-Mixed Social Media Comments
Department of Data Science and Engineering, Indian Institute of Science Education and Research(数据科学与工程系,印度科学教育与研究学院);Oracle Industries AI, Oracle Corporation(Oracle人工智能部,Oracle公司)
Don't Erase, Inform! Detecting and Contextualizing Harmful Language in Cultural Heritage Collections
National Technical University of Athens(希腊国家技术大学);DFF - Deutsches Filminstitut & Filmmuseum(德国电影学院及电影博物馆);Europeana Foundation(欧洲ana基金会);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学)
Detecting Gender Bias in Transformer-based Models: A Case Study on BERT
University of Connecticut(康涅狄格大学);University of New Mexico(新墨西哥大学);George Mason University(乔治梅森大学);Illinois Institute of Technology(伊利诺伊理工学院);Stevens Institute of Technology(斯蒂文斯理工学院)
From Bias to Balance: Detecting Facial Expression Recognition Biases in Large Multimodal Foundation Models
Lake Wales High School(莱克威尔士高中);Thomas Jefferson Sr. High School(托马斯·杰斐逊高中);Bellarmine College Preparatory(贝拉明学院预科学校);Algoverse AI Research(Algoverse AI研究机构)
Detecting algorithmic bias in medical-AI models using trees
School of Industrial and Systems Engineering, Georgia Institute of Technology(佐治亚理工学院工业与系统工程学院);Department of Biomedical Informatics, Emory University School of Medicine(埃默里大学医学院生物医学信息学系);Department of Surgery, Duke University School of Medicine(杜克大学医学院外科系)
A Systematic Review of Machine Learning Approaches for Detecting Deceptive Activities on Social Media: Methods, Challenges, and Biases
University of Pennsylvania(宾夕法尼亚大学);Northeastern University(东北大学);New York University(纽约大学);Georgia Institute of Technology(佐治亚理工学院);University of California, Berkeley(加州大学伯克利分校)
Detecting Dataset Bias in Medical AI: A Generalized and Modality-Agnostic Auditing Framework
The Johns Hopkins University(约翰霍普金斯大学);The Johns Hopkins University Applied Physics Laboratory(约翰霍普金斯大学应用物理实验室);Center for Devices and Radiological Health, U.S. Food and Drug Administration(美国食品药品监督管理局设备与放射健康中心)