arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.09027cs.DC
收藏

多智能体系统中的可信人工智能:分布式学习的隐私与安全概览

Trusted AI in Multi-agent Systems: An Overview of Privacy and Security for Distributed Learning

Chuan Ma, Jun Li, Kang Wei, Bo Liu, Ming Ding, Long Yuan, Zhu Han, H. Vincent Poor

AI总结:

本文从信息交换层级视角系统综述了分布式机器学习中的隐私与安全风险,分析各层级的攻击机制与防御方法,并展望未来研究方向。

摘要:

受分布式终端用户设备(UE)计算能力不断提升以及人们对共享私有数据日益增长的担忧所驱动,近年来,能够在分布式UE上处理的机器学习(ML)和人工智能(AI)引起了广泛关注。具体而言,在这一范式中,ML过程的部分环节被外包给多个分布式UE,随后处理后的ML信息在某一层级上被中央服务器聚合,从而将集中式ML过程转变为分布式过程,并带来显著收益。然而,这种新的分布式ML范式也引发了新的隐私和安全风险。本文从信息交换层级的独特视角出发,对分布式ML中新兴的安全与隐私风险进行了综述。这些信息交换层级根据ML过程的关键步骤定义,即:i)预处理数据层级,ii)学习模型层级,iii)提取知识层级,以及iv)中间结果层级。我们基于对当前最先进攻击机制的概览,探索并分析了每个信息交换层级面临的潜在威胁,然后讨论了针对这些威胁的可能防御方法。最后,我们对该关键领域未来研究面临的挑战和可能方向进行了展望,以此完成本综述。

英文摘要:

Motivated by the advancing computational capacity of distributed end-user equipments (UEs), as well as the increasing concerns about sharing private data, there has been considerable recent interest in machine learning (ML) and artificial intelligence (AI) that can be processed on on distributed UEs. Specifically, in this paradigm, parts of an ML process are outsourced to multiple distributed UEs, and then the processed ML information is aggregated on a certain level at a central server, which turns a centralized ML process into a distributed one, and brings about significant benefits. However, this new distributed ML paradigm raises new risks of privacy and security issues. In this paper, we provide a survey of the emerging security and privacy risks of distributed ML from a unique perspective of information exchange levels, which are defined according to the key steps of an ML process, i.e.: i) the level of preprocessed data, ii) the level of learning models, iii) the level of extracted knowledge and, iv) the level of intermediate results. We explore and analyze the potential of threats for each information exchange level based on an overview of the current state-of-the-art attack mechanisms, and then discuss the possible defense methods against such threats. Finally, we complete the survey by providing an outlook on the challenges and possible directions for future research in this critical area.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑