AI Safety is an emerging area of critical importance to the safe adoption and deployment of AI systems. With the rapid proliferation of AI and especially with the recent advancement of Generative AI (or GAI), the technology ecosystem behind the design, development, adoption, and deployment of AI systems has drastically changed, broadening the scope of AI Safety to address impacts on public safety and national security. In this paper, we propose a novel architectural framework for understanding and analyzing AI Safety; defining its characteristics from three perspectives: Trustworthy AI, Responsible AI, and Safe AI. We provide an extensive review of current research and advancements in AI safety from these perspectives, highlighting their key challenges and mitigation approaches. Through examples from state-of-the-art technologies, particularly Large Language Models (LLMs), we present innovative mechanism, methodologies, and techniques for designing and testing AI safety. Our goal is to promote advancement in AI safety research, and ultimately enhance people's trust in digital transformation.
Disentangling AI Alignment: A Structured Taxonomy Beyond Safety and Ethics
Responsible AI & Machine Ethics Research Group (RAIME)(负责任的人工智能与机器伦理研究组);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);Saarland Informatics Campus D 3 2(萨尔兰州信息学校园D32)
针对 AI Safety、AI Alignment 与 Machine Ethics 边界模糊的问题,本文提出按目的、范围和构成主体划分的结构化对齐分类法,以促进跨领域整合。
AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies
Virginia Tech(弗吉尼亚理工大学);Stanford University(斯坦福大学);Harvard University(哈佛大学);Lapis Labs(拉皮斯实验室);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Northeastern University(东北大学);University of California, Berkeley(加利福尼亚大学伯克利分校);University of Chicago(芝加哥大学)
On AI Safety and Security Technical Debt in Engineering AI-Enabled Systems
University of Birmingham(伯明翰大学);HBKU(哈马德·本·哈利法大学);Bournemouth University(伯恩茅斯大学);Brunel University London(伦敦布鲁内尔大学);University of Hawaii(夏威夷大学);College of Science and Engineering, HBKU(哈马德·本·哈利法大学科学与工程学院)
Charting the European LLM Benchmarking Landscape: A New Taxonomy and a Set of Best Practices
Jožef Stefan Institute(乔塞夫·斯塔芬研究所);University of Ljubljana(卢布尔雅那大学);Faculty of Arts, University of Ljubljana(艺术学院,卢布尔雅那大学);Faculty of Computer and Information Science, University of Ljubljana(计算机与信息科学学院,卢布尔雅那大学);Institute of Contemporary History(现代史研究所)
Evolving Safety Landscape of Multi-modal Large Language Models: A Survey of Emerging Threats and Safeguards
University of Alabama at Birmingham(阿拉巴马大学伯明翰分校);NVIDIA(英伟达公司);Penn State University(宾夕法尼亚州立大学);Columbia University(哥伦比亚大学);University of Missouri-Kansas City(密苏里大学堪萨斯分校);Florida State University(佛罗里达州立大学);Auburn University(奥本大学)
Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy
University of Southern Queensland(南昆士兰大学);Lingnan University(岭南大学);Wuhan University of Technology(武汉理工大学);University of Electronic Science and Technology of China(电子科技大学);Hong Kong Polytechnic University(香港理工大学)
本文系统综述机器遗忘的最新方法、指标、数据集与挑战,并指出其在隐私、安全、公平及可信 AI 中的未来方向。
Safe-SAIL: Towards a Fine-grained Safety Landscape of Large Language Models via Sparse Autoencoder Interpretation Framework
Alibaba Group(阿里巴巴集团);The State Key Laboratory of Blockchain and Data Security, Zhejiang University(浙江大学区块链与数据安全国家重点实验室);Language Technology Lab, University of Cambridge(剑桥大学语言技术实验室);Renmin University of China(中国人民大学)
Evaluation of Audio Language Models for Fairness, Safety, and Security
Computer Science, Taibah University, Saudi Arabia(塔布大学计算机科学系,沙特阿拉伯);La Sapienza, University of Rome, Rome, Italy(罗马大学拉·萨皮恩扎分校,意大利);CISPA Helmholtz Center for Information Security, Saarbrücken, Germany(信息安全赫尔姆霍茨研究中心,德国萨尔布吕肯);University of Cagliari, Cagliari, Italy(卡利亚里大学,意大利卡利亚里)
A Security Risk Taxonomy for Prompt-Based Interaction With Large Language Models
ELLIS Alicante(欧洲学习与智能系统实验室阿利坎特分部);Czech Institute of Informatics, Robotics, and Cybernetics, Czech Technical University in Prague(捷克布拉格技术大学捷克信息学、机器人学与控制论研究所);Delft University of Technology(代尔夫特理工大学)