Machine-learning models are known to be vulnerable to evasion attacks that perturb model inputs to induce misclassifications. In this work, we identify real-world scenarios where the true threat cannot be assessed accurately by existing attacks. Specifically, we find that conventional metrics measuring targeted and untargeted robustness do not appropriately reflect a model's ability to withstand attacks from one set of source classes to another set of target classes. To address the shortcomings of existing methods, we formally define a new metric, termed group-based robustness, that complements existing metrics and is better-suited for evaluating model performance in certain attack scenarios. We show empirically that group-based robustness allows us to distinguish between models' vulnerability against specific threat models in situations where traditional robustness metrics do not apply. Moreover, to measure group-based robustness efficiently and accurately, we 1) propose two loss functions and 2) identify three new attack strategies. We show empirically that with comparable success rates, finding evasive samples using our new loss functions saves computation by a factor as large as the number of targeted classes, and finding evasive samples using our new attack strategies saves time by up to 99\% compared to brute-force search methods. Finally, we propose a defense method that increases group-based robustness by up to 3.52$\times$.
Towards Evaluating the Robustness of Automatic Speech Recognition Systems via Audio Style Transfer
Beijing University of Posts and Telecommunications(北京邮电大学);Tsinghua University(清华大学);CSIRO’s Data61(澳大利亚联邦科学与工业研究组织Data61);Nanyang Technological University(南洋理工大学)
Improving Robustness against Real-World and Worst-Case Distribution Shifts through Decision Region Quantification
University of Erlangen-Nürnberg(埃尔朗根-纽伦堡大学);Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);Hausdorff Center for Mathematics, University of Bonn(波恩大学豪斯多夫数学中心);McGill University(麦吉尔大学);Google Deepmind(谷歌DeepMind)
Generalized Real-World Super-Resolution through Adversarial Robustness
Center for Research and Formation in Artificial Intelligence, Universidad de los Andes(安第斯大学人工智能研究与形成中心);King Abdullah University of Science and Technology (KAUST)(阿卜杜拉国王科技大学);Computer Vision Lab, ETH Zürich(苏黎世联邦理工学院计算机视觉实验室)
RobustMAD: Evaluating Real-World Robustness of Multimodal Small Language Models for Deployable Anomaly Detection Assistants
Singapore University of Technology and Design(新加坡科技设计大学);Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局);Nanyang Technological University(南洋理工大学);Chongqing University(重庆大学)
On the Robustness of Open-World Test-Time Training: Self-Training with Dynamic Prototype Expansion
South China University of Technology(华南理工大学);Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局(A*STAR)信息通信研究院(I2R))
Enhance Sample Efficiency and Robustness of End-to-end Urban Autonomous Driving via Semantic Masked World Model
Institute of Automation, Chinese Academy of Science(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);The University of Hong Kong(香港大学);Tsinghua University(清华大学);University of Science and Technology Beijing(北京科技大学)
Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);University of Chinese Academy of Sciences(中国科学院大学);University of Technology Sydney(悉尼科技大学);Tsinghua University(清华大学)