Safety alignment is an essential research topic for real-world AI applications. Despite the multifaceted nature of safety and trustworthiness in AI, current safety alignment methods often focus on a comprehensive notion of safety. By carefully assessing models from the existing safety-alignment methods, we found that, while they generally improved overall safety performance, they failed to ensure safety in specific categories. Our study first identified the difficulty of eliminating such vulnerabilities without sacrificing the model's helpfulness. We observed that, while smaller KL penalty parameters, increased training iterations, and dataset cleansing can enhance safety, they do not necessarily improve the trade-off between safety and helpfulness. We discovered that safety alignment could even induce undesired effects and result in a model that prefers generating negative tokens leading to rejective responses, regardless of the input context. To address this, we introduced a learning-free method, Token-level Safety-Debiased Inference (TSDI), to estimate and correct this bias during the generation process using randomly constructed prompts. Our experiments demonstrated that our method could enhance the model's helpfulness while maintaining safety, thus improving the trade-off Pareto-front.
Parameter-efficient Modularised Bias Mitigation via AdapterFusion
Johannes Kepler University Linz(林茨约翰内斯·开普勒大学);Brown University(布朗大学);Dataminr(Dataminr公司);University of Tübingen(图宾根大学);Linz Institute of Technology(林茨技术研究所)
Identifying and Mitigating Social Bias Knowledge in Language Models
Zhejiang University(浙江大学);Nanyang Technological University(南洋理工大学);Angelalign Technology Inc.(时代天使科技有限公司);A*STAR Centre for Frontier AI Research(新加坡科研局前沿人工智能研究中心);ZJU-Angelalign R&D Center for Intelligence Healthcare(浙江大学时代天使智能医疗研发中心)
Assessing the quality and coherence of word embeddings after SCM-based intersectional bias mitigation
Informatics Institute, University of Amsterdam(阿姆斯特丹大学信息学院);Department of Computer Science and Technology, SUNY Empire State University(SUNY帝国州大学计算机科学与技术系)
LLM4Rec: Large Language Models for Multimodal Generative Recommendation with Causal Debiasing
Department of Software \& Microelectronics Peking University Beijing, China;Department of Software \& Microelectronics Peking University Beijing, China hangli\;Department of Software \& Microelectronics Peking University Beijing, China zehua\;Department of Software \& Microelectronics Peking University Beijing, China xiaofan\;Economic Law School China University of Political Science;Peking University Changsha, China
RobustDebias: Debiasing Language Models using Distributionally Robust Optimization
Deep Gandhi University of Alberta(Deep Gandhi 阿尔伯塔大学);Katyani Singh University of Alberta(Katyani Singh 阿尔伯塔大学);Nidhi Hegde University of Alberta(Nidhi Hegde 阿尔伯塔大学);Alberta Machine Intelligence Institute(阿尔伯塔人工智能研究所)
Agentic AI for Autonomous Defense in Software Supply Chain Security: Beyond Provenance to Vulnerability Mitigation
Faculty of Computer and Information System(计算机与信息系统学院);Islamic University of Madinah(麦地那伊斯兰大学);Faculty of Computer Studies(计算机研究学院);Arab Open University-Bahrain(巴林阿拉伯开放大学)
AI Slop and Hallucinations in Vulnerability Assessment: A Survey on Reasoning Failures and Trustworthy Mitigation
University of New South Wales(新南威尔士大学);University of Wollongong(伍伦贡大学);Nanjing University of Information Science & Technology(南京信息工程大学);Griffith University(格里菲斯大学);Nanyang Technological University(南洋理工大学)
Textual Data Bias Detection and Mitigation -- An Extensible Pipeline with Experimental Evaluation
organization= Fraunhofer Institute for Intelligent Analysis;organization= Trustworthiness Theory, Technology \& Engineering Lab, Huawei Technologies Co., Ltd , country= China;organization= Lamarr Institute for Machine Learning;organization= B-IT Emeritus Research Group AI Foundations, University of Bonn , country= Germany
Simulating a Bias Mitigation Scenario in Large Language Models
Department of Computer Science, Bowling Green State University(计算机科学系,布恩维尔州立大学);School of Computing, University of Nebraska–Lincoln(计算学院,内布拉斯加-林肯大学);Department of Civil, Environmental, and Ocean Engineering, Stevens Institute of Technology(土木、环境与海洋工程系,史蒂文斯理工学院);Department of Computer Science, University of South Carolina(计算机科学系,南卡罗来纳大学);Artificial Intelligence Institute, University of South Carolina(人工智能研究院,南卡罗来纳大学)