arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1708.03366cs.LGcs.AIcs.CRcs.SYeess.SY
收藏

鲁棒线性分类:一种应对训练数据攻击的方法

Resilient Linear Classification: An Approach to Deal with Attacks on Training Data

Department of Computer \& Information Science University of Pennsylvania;University of Pennsylvania

Sangdon Park, James Weimer, Insup Lee

AI总结:

本文提出一种鲁棒线性分类方法,通过引入多数约束,提高对抗训练数据攻击的鲁棒性,验证了传统算法在攻击下的脆弱性。

摘要:

数据驱动技术用于控制自动驾驶车辆、处理能源管理的需求响应以及建模人体生理学用于医疗设备。这些技术从训练数据中提取模型,其性能通常基于训练数据中的随机误差进行分析。然而,如果训练数据被攻击者恶意篡改,这些攻击对数据驱动CPS底层学习算法的影响尚未被考虑。本文分析了分类算法对训练数据攻击的鲁棒性。具体而言,提出了一种通用度量标准,用于衡量分类算法对训练数据最坏情况篡改的鲁棒性。使用该度量标准,我们显示传统线性分类算法在受限条件下具有鲁棒性。为克服这些限制,我们提出了一种具有多数约束的线性分类算法,并证明其比传统算法更鲁棒。在合成数据和一个现实世界的回顾性心律失常医疗案例研究中的评估显示,传统算法对篡改的训练数据易受攻击,而所提算法更具鲁棒性(以最坏情况篡改衡量)。

英文摘要:

Data-driven techniques are used in cyber-physical systems (CPS) for controlling autonomous vehicles, handling demand responses for energy management, and modeling human physiology for medical devices. These data-driven techniques extract models from training data, where their performance is often analyzed with respect to random errors in the training data. However, if the training data is maliciously altered by attackers, the effect of these attacks on the learning algorithms underpinning data-driven CPS have yet to be considered. In this paper, we analyze the resilience of classification algorithms to training data attacks. Specifically, a generic metric is proposed that is tailored to measure resilience of classification algorithms with respect to worst-case tampering of the training data. Using the metric, we show that traditional linear classification algorithms are resilient under restricted conditions. To overcome these limitations, we propose a linear classification algorithm with a majority constraint and prove that it is strictly more resilient than the traditional algorithms. Evaluations on both synthetic data and a real-world retrospective arrhythmia medical case-study show that the traditional algorithms are vulnerable to tampered training data, whereas the proposed algorithm is more resilient (as measured by worst-case tampering).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑