arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.12020cs.LGcs.CRstat.ML
收藏

A Separation Result Between Data-oblivious and Data-aware Poisoning Attacks

Columbia University(哥伦比亚大学);UC Berkeley(加州大学伯克利分校);NTT Research(NTT研究所);University of Wisconsin(威斯康星大学);Princeton(普林斯顿大学);University of Virginia(弗吉尼亚大学);Google Research - Brain Team(谷歌研究院 - 大脑团队)

Samuel Deng, Sanjam Garg, Somesh Jha, Saeed Mahloujifar, Mohammad Mahmoody, Abhradeep Thakurta

英文摘要:

Poisoning attacks have emerged as a significant security threat to machine learning algorithms. It has been demonstrated that adversaries who make small changes to the training set, such as adding specially crafted data points, can hurt the performance of the output model. Some of the stronger poisoning attacks require the full knowledge of the training data. This leaves open the possibility of achieving the same attack results using poisoning attacks that do not have the full knowledge of the clean training set. In this work, we initiate a theoretical study of the problem above. Specifically, for the case of feature selection with LASSO, we show that full-information adversaries (that craft poisoning examples based on the rest of the training data) are provably stronger than the optimal attacker that is oblivious to the training set yet has access to the distribution of the data. Our separation result shows that the two setting of data-aware and data-oblivious are fundamentally different and we cannot hope to always achieve the same attack or defense results in these scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑