arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.07960cs.CR
收藏

ADMIn:针对数据集、模型与输入的攻击——一种面向基于人工智能软件的风险模型

ADMIn: Attacks on Dataset, Model and Input. A Threat Model for AI Based Software

Vimal Kumar, Juliette Mayo, Khadija Bahiss

AI总结:

本文提出ADMIn风险模型,结合AI软件开发过程模型与对抗性攻击分类体系,系统化识别基于AI软件的威胁,并在两个真实系统中验证其有效性。

摘要:

机器学习(ML)和人工智能(AI)技术如今已在软件产品和服务中普遍应用。因此,在对系统进行风险建模时,除了考虑针对软件本身的威胁外,还必须考虑ML和AI技术所特有的威胁。本文提出了一种可用于系统化发现基于AI软件威胁的风险模型。该风险模型由两个主要部分组成:一个面向基于AI软件的软件开发过程模型,以及一个基于对抗性AI研究中发现的攻击而构建的攻击分类体系。我们将该风险模型应用于两个真实的基于AI软件,并讨论了应用过程及所发现的威胁。

英文摘要:

Machine learning (ML) and artificial intelligence (AI) techniques have now become commonplace in software products and services. When threat modelling a system, it is therefore important that we consider threats unique to ML and AI techniques, in addition to threats to our software. In this paper, we present a threat model that can be used to systematically uncover threats to AI based software. The threat model consists of two main parts, a model of the software development process for AI based software and an attack taxonomy that has been developed using attacks found in adversarial AI research. We apply the threat model to two real life AI based software and discuss the process and the threats found.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑