arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.04736cs.CRcs.SE

基于机器学习的软件系统的安全性:威胁、实践与挑战综述

Security for Machine Learning-based Software Systems: a survey of threats, practices and challenges

Huaming Chen, M. Ali Babar

AI总结:

该综述针对基于机器学习的软件系统(MLBSS)的安全挑战,指出其全生命周期存在不同漏洞风险,现有研究多聚焦数据与模型,首次从多维度系统梳理MLBSS安全威胁,填补了相关领域综述空白。

摘要:

机器学习(ML)的快速发展已在计算机视觉、视频与语音识别等诸多领域展现出卓越性能,如今正越来越多地被应用于软件系统中,以实现核心任务的自动化。然而,如何安全地开发现代基于机器学习的软件系统(MLBSS)仍是一大挑战,对此考虑不足将极大限制其在安全关键领域的应用。一个值得关注的问题是,当前MLBSS的开发往往较为仓促,暴露给外部用户和攻击者的潜在漏洞与隐私问题会被大幅忽视,且难以被识别。此外,由于模型和数据的固有局限性以及外部对手的能力,基于机器学习的软件系统在从需求分析到系统维护的不同开发阶段,会呈现出不同的新型漏洞风险。因此,这类智能系统的成功构建需要软件工程、系统安全与机器学习等不同研究领域的共同投入。近期大多数关于机器学习安全问题的研究都高度聚焦于数据和模型,已将对抗性攻击纳入考量范围。在本研究中,我们认为基于机器学习的软件系统的安全问题可能源于固有系统缺陷或外部对抗性攻击,且应在整个生命周期中落实安全开发实践。虽然机器学习已成为现有软件工程实践的新威胁领域,但目前尚无涵盖该主题的综述研究。总体而言,我们对MLBSS的安全性进行了全面综述,从安全威胁的三个不同维度的结构化梳理出发,提供了系统性的认知……

英文摘要:

The rapid development of Machine Learning (ML) has demonstrated superior performance in many areas, such as computer vision, video and speech recognition. It has now been increasingly leveraged in software systems to automate the core tasks. However, how to securely develop the machine learning-based modern software systems (MLBSS) remains a big challenge, for which the insufficient consideration will largely limit its application in safety-critical domains. One concern is that the present MLBSS development tends to be rush, and the latent vulnerabilities and privacy issues exposed to external users and attackers will be largely neglected and hard to be identified. Additionally, machine learning-based software systems exhibit different liabilities towards novel vulnerabilities at different development stages from requirement analysis to system maintenance, due to its inherent limitations from the model and data and the external adversary capabilities. The successful generation of such intelligent systems will thus solicit dedicated efforts jointly from different research areas, i.e., software engineering, system security and machine learning. Most of the recent works regarding the security issues for ML have a strong focus on the data and models, which has brought adversarial attacks into consideration. In this work, we consider that security for machine learning-based software systems may arise from inherent system defects or external adversarial attacks, and the secure development practices should be taken throughout the whole lifecycle. While machine learning has become a new threat domain for existing software engineering practices, there is no such review work covering the topic. Overall, we present a holistic review regarding the security for MLBSS, which covers a systematic understanding from a structure review of three distinct aspects in terms of security threats...

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑