The Department of Defense (DoD) has significantly increased its investment in the design, evaluation, and deployment of Artificial Intelligence and Machine Learning (AI/ML) capabilities to address national security needs. While there are numerous AI/ML successes in the academic and commercial sectors, many of these systems have also been shown to be brittle and nonrobust. In a complex and ever-changing national security environment, it is vital that the DoD establish a sound and methodical process to evaluate the performance and robustness of AI/ML models before these new capabilities are deployed to the field. This paper reviews the AI/ML development process, highlights common best practices for AI/ML model evaluation, and makes recommendations to DoD evaluators to ensure the deployment of robust AI/ML capabilities for national security needs.
Key Principles of Graph Machine Learning: Representation, Robustness, and Generalization
Institut Polytechnique de Paris(巴黎理工学院);École Polytechnique(巴黎综合理工学院);CentraleSupélec(中央理工-高等电力学院);Télécom Paris(巴黎高等电信学院);Università di Pisa(比萨大学);INRIA(法国国家信息与自动化研究所)
Principles of Lipschitz continuity in neural networks
University of Galway(高威大学);Research Ireland(爱尔兰研究中心);Irish National Centre for Research Training in AI(爱尔兰国家人工智能研究培训中心);School of Computer Science(计算机学院)
Probing the Robustness of Independent Mechanism Analysis for Representation Learning
Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Eberhard Karls University of Tübingen(埃伯哈德·卡尔斯·图宾根大学);Swiss Federal Institute of Technology Zürich(苏黎世联邦理工学院);University of Cambridge(剑桥大学)
Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);School of Mathematical Sciences, University of Chinese Academy of Sciences(中国科学院大学数学科学学院)
Robust Processing and Learning: Principles, Methods, and Wireless Applications
Department of Electrical and Electronic Engineering, Imperial College London(帝国理工学院伦敦分校电子与电气工程系);Department of Electrical and Computer Engineering, National Yang Ming Chiao Tung University(国立阳明交通大学电子与计算机工程系)
1st ICLR International Workshop on Privacy, Accountability, Interpretability, Robustness, Reasoning on Structured Data (PAIR^2Struct)
Rutgers University(罗格斯大学);Hong Kong Polytechnic University(香港理工大学);Massachusetts Institute of Technology(麻省理工学院);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);Columbia University(哥伦比亚大学);Peking University(北京大学)
Robustness and Cybersecurity in the EU Artificial Intelligence Act
University of Tübingen(图宾根大学);IBM Research Africa(IBM非洲研究中心);Saarland University(萨尔兰州大学);CSZ Institute for Artificial Intelligence and Law, University of Tübingen(人工智能与法律研究所,图宾根大学)