The rapid advancement of artificial intelligence systems has brought the challenge of AI alignment to the forefront of research, particularly in complex decision-making and task execution. As these systems surpass human-level performance in sophisticated problems, ensuring their alignment with human values, intentions, and ethical guidelines becomes crucial. Building on previous work in explanation generation for human-agent alignment, we address the more complex dynamics of multi-agent systems and human-AI teams. This paper introduces a novel approach to model alignment through weak-to-strong generalization in the context of language models. We present a framework where a strong model facilitates the improvement of a weaker model, bridging the gap between explanation generation and model alignment. Our method, formalized as a facilitation function, allows for the transfer of capabilities from advanced models to less capable ones without direct access to extensive training data. Our results suggest that this facilitation-based approach not only enhances model performance but also provides insights into the nature of model alignment and the potential for scalable oversight of AI systems.
Gradual Vigilance and Interval Communication: Enhancing Value Alignment in Multi-Agent Debates
National Engineering Research Center of Educational Big Data, Central China Normal University(华中师范大学教育大数据国家工程研究中心);Faculty of Artificial Intelligence in Education, Central China Normal University(华中师范大学人工智能教育学部)
The Truth Becomes Clearer Through Debate! Multi-Agent Systems with Large Language Models Unmask Fake News
Gaoling School of Artificial Intelligence, Renmin University of China(仁爱大学人工智能学院);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Efficient LLM Safety Evaluation through Multi-Agent Debate
Beijing Institute of AI Safety and Governance(北京人工智能安全与治理研究院);Beijing Key Laboratory of Safe AI and Super Alignment(北京安全人工智能与超对齐重点实验室);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);CSE, The Chinese University of Hong Kong(香港中文大学电子工程系);University of Chinese Academy of Sciences(中国科学院大学);Department of Mathematics, The Chinese University of Hong Kong(香港中文大学数学系);Long-term AI(长期人工智能)
AI Debaters are More Persuasive when Arguing in Alignment with Their Own Beliefs
FAIR, IALAB, Universidad de Buenos Aires(FAIR、IALAB、布宜诺斯艾利斯大学);Universidad de Buenos Aires(布宜诺斯艾利斯大学);Universidad Nacional de Córdoba(科尔多瓦国立大学);BAISH, Universidad de Buenos Aires(BAISH、布宜诺斯艾利斯大学);Instituto de Investigación en Informática LIDI, Universidad Nacional de La Plata(信息研究所LIDI、拉普拉塔国立大学;CONICET);CONICET(计算机科学与工程系,南大学及ICIC UNS-CONICET);Dept. of Comp. Sci. and Eng., Universidad Nacional del Sur & ICIC UNS-CONICET(人工智能研究所(IIIA-CSIC),西班牙);Artificial Intelligence Research Institute (IIIA-CSIC), ES
UK AI Security Institute, Centre for the Governance of AI(英国人工智能安全研究所,人工智能治理中心);UK AI Security Institute, New York University(英国人工智能安全研究所,纽约大学);UK AI Security Institute(英国人工智能安全研究所)
Macro: Enhancing Multilingual Counterfactual Explanations through Alignment-as-Preference Optimization
Technische Universität Berlin(柏林技术大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);University of Duisburg-Essen(杜伊斯堡- Essen大学);LMU Munich(慕尼黑大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Saarland Informatics Campus(萨尔兰州信息学校区);BIFOLD – Berlin Institute for the Foundations of Learning and Data(柏林学习与数据基础研究院);Centre for European Research in Trusted AI (CERTAIN)(可信人工智能欧洲研究中心)
Explanations of Large Language Models Explain Language Representations in the Brain
Iran University of Science and Technology(伊朗科学技术大学);University of Tehran(德黑兰大学);Institute for Research in Fundamental Sciences(基础科学研究所);Khatam University(哈塔姆大学)
ChatGPT Rates Natural Language Explanation Quality Like Humans: But on Which Scales?
Luddy School of Informatics, Computing, and Engineering, Indiana University Bloomington(印第安纳大学伯明顿分校勒迪信息、计算与工程学院);School of AI Convergence, Soongsil University(崇实大学人工智能融合学院);Soongsil University(崇实大学)
Bridging Collaborative Filtering and Large Language Models with Dynamic Alignment, Multimodal Fusion and Evidence-grounded Explanations
Department of Software \& Microelectronics, Peking University, Beijing, China;Economic Law School, China University of Political Science;Financial Media, Peking University, ChangSha, China
Explainable Molecular Property Prediction: Aligning Chemical Concepts with Predictions via Language Models
Department of Computing, The Hong Kong Polytechnic University(计算系,香港理工大学);Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University(数据科学与人工智能系,香港理工大学);Department of Computing and Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University(计算系和数据科学与人工智能系,香港理工大学);Department of Applied Physics, The Hong Kong Polytechnic University(应用物理系,香港理工大学);Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR)(高性能计算研究所,科技研究局(A*STAR))
Assessing Alignment and Stability of Feature Importance Explanations via Weight of Evidence
SMARTEST Research Center(SMARTEST研究中心);eCampus University(eCampus大学);Barcelona Supercomputing Center(巴塞罗那超级计算中心);University of Florence(佛罗伦萨大学);University of Pisa(比萨大学)
Hybrid Explanation-Guided Learning for Transformer-Based Chest X-Ray Diagnosis
ARTORG Center for Biomedical Engineering Research, University of Bern(ARTORG生物医学工程研究中心,伯恩大学);Inselspital (Bern University Hospital)(Inselspital(伯恩大学医院));Insel Gruppe Bern Universitätsinstitut für Diagnostische, Interventionelle und Pädiatrische Radiologie(Bern大学诊断、介入和儿科放射学研究所);Department of Radiation Oncology, Inselspital, Bern University Hospital(放射肿瘤科,Inselspital,伯恩大学医院)
Towards Multi-dimensional Explanation Alignment for Medical Classification
King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);HKUST(GZ)(香港科技大学(广州));Tongji University(同济大学);Ant Group(蚂蚁集团);The University of Auckland(奥克兰大学);RIKEN Center for Advanced Intelligence Project (AIP)(理化学研究所先进智能项目中心)