arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.06512cs.CRcs.SE
收藏

以资产为中心的基于AI的系统威胁建模

Asset-centric Threat Modeling for AI-based Systems

Jan von der Assen, Jamo Sharif, Chao Feng, Christian Killer, Gérôme Bovet, Burkhard Stiller

AI总结:

本文提出ThreatFinderAI方法和工具,通过指导和自动化建模AI相关资产、威胁、对策及量化残余风险,解决了AI系统威胁建模探索不足的问题,并在医疗和LLM应用案例中验证了其有效性和可用性。

摘要:

威胁建模是一种通过了解对手造成的未来潜在损害区域来安全开发系统的流行方法。然而,对于依赖人工智能的系统的威胁建模目前仍未得到充分探索。虽然传统的威胁建模方法和工具未能解决AI相关的威胁,但关于这一交叉领域的研究缺乏能够指导和自动化该过程,并提供方法在实践中站得住脚的证据的解决方案。因此,本文提出了ThreatFinderAI,这是一种提供指导和自动化以建模AI相关资产、威胁、对策并量化残余风险的方法和工具。为了评估该方法的实用性,参与者被指派重新创建由基于AI的医疗保健平台的网络安全专家开发的威胁模型。此外,该方法还通过案例研究用于识别和讨论基于LLM的应用中的战略风险。总体而言,该解决方案的可用性获得了良好评价,并有效地支持了威胁识别和风险讨论。

英文摘要:

Threat modeling is a popular method to securely develop systems by achieving awareness of potential areas of future damage caused by adversaries. However, threat modeling for systems relying on Artificial Intelligence is still not well explored. While conventional threat modeling methods and tools did not address AI-related threats, research on this amalgamation still lacks solutions capable of guiding and automating the process, as well as providing evidence that the methods hold up in practice. Consequently, this paper presents ThreatFinderAI, an approach and tool providing guidance and automation to model AI-related assets, threats, countermeasures, and quantify residual risks. To evaluate the practicality of the approach, participants were tasked to recreate a threat model developed by cybersecurity experts of an AI-based healthcare platform. Secondly, the approach was used to identify and discuss strategic risks in an LLM-based application through a case study. Overall, the solution's usability was well-perceived and effectively supports threat identification and risk discussion.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑