Adversarial examples are malicious inputs to machine learning models that trigger a misclassification. This type of attack has been studied for close to a decade, and we find that there is a lack of study and formalization of adversary knowledge when mounting attacks. This has yielded a complex space of attack research with hard-to-compare threat models and attacks. We focus on the image classification domain and provide a theoretical framework to study adversary knowledge inspired by work in order theory. We present an adversarial example game, inspired by cryptographic games, to standardize attacks. We survey recent attacks in the image classification domain and classify their adversary's knowledge in our framework. From this systematization, we compile results that both confirm existing beliefs about adversary knowledge, such as the potency of information about the attacked model as well as allow us to derive new conclusions on the difficulty associated with the white-box and transferable threat models, for example, that transferable attacks might not be as difficult as previously thought.
SoK: Challenges in Tabular Membership Inference Attacks
Department of Computer Science, Faculty of Sciences of the University of Porto, Portugal(葡萄牙波尔图大学科学学院计算机科学系);SnT, University of Luxembourg, Luxembourg(卢森堡大学SnT学院);TekPrivacy, Portugal(葡萄牙TekPrivacy)
SoK: The Pitfalls of Deep Reinforcement Learning for Cybersecurity
King’s College London(伦敦国王学院);The Alan Turing Institute(艾伦·图灵研究所);University College London(伦敦大学学院);Cardiff University(卡迪夫大学);KU Leuven(鲁汶大学);Devotion AI Labs(Devotion AI 实验室)
University of Maryland College Park(马里兰大学帕克分校);University of Virginia(弗吉尼亚大学);Cornell University(康奈尔大学);Columbia University(哥伦比亚大学);University of California Los Angeles(加州大学洛杉矶分校)
SA-Attack: Improving Adversarial Transferability of Vision-Language Pre-training Models via Self-Augmentation
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Nanyang Technological University(南洋理工大学);National University of Singapore(新加坡国立大学);Sun Yat-sen University(中山大学)