从节拍到泄露:攻击性人工智能如何从播放列表中推断敏感用户信息
From Beats to Breaches:How Offensive AI Infers Sensitive User Information from Playlists
AI总结:
研究攻击性人工智能如何从音乐播放列表推断用户敏感信息,开发工具musicPIIrate利用深度学习架构达先进准确率,能推断多种属性,还提出防御框架JamShield,为播放列表PII推断提供基准并展示缓解效果。
摘要:
人工智能的广泛整合催生了攻击性人工智能,即利用人工智能在网络杀伤链中达成恶意目的。一个关键表现是用户属性推断攻击,人工智能从无害的公共数据中推断敏感的个人身份信息(PII)。我们探讨了音乐流媒体生态系统(用户常发布公共播放列表)如何被用于攻击性人工智能。为量化此威胁,我们开发了musicPIIrate。该工具利用深度学习架构,结合独立数据表示和播放列表集合中的结构信息。设计探索了基于集合的方法(如深度集合)和建模播放列表间关系的方法(如图神经网络)。实证评估表明musicPIIrate达到了先进的推断准确率,能成功推断多种属性。为应对此漏洞,我们提出了JamShield,一种轻量级防御框架,可注入虚拟播放列表降低推断F1分数。这项工作为基于播放列表的PII推断提供了初始攻击性人工智能基准,并引入了有缓解效果的防御方法。
英文摘要:
The pervasive integration of AI has enabled Offensive AI: the exploitation of AI for malicious ends across the cyber-kill chain. A critical manifestation is the user attribute inference attack, where AI infers sensitive Personally Identifiable Information (PII) from innocuous public data. We explore how music streaming ecosystems, where users routinely release public playlists, can be exploited for Offensive AI. To quantify this threat, we developed musicPIIrate. This novel tool leverages deep learning architectures that utilize both standalone data representations and the structural information embedded in a user's playlist collection. Our design explores set-based approaches (e.g., Deep Sets) and methodologies modeling relationships between playlists (e.g., Graph Neural Networks), which we also combine to leverage both perspectives. Our approach addresses feature extraction from unordered, variable-length set data, enabling accurate PII prediction. Empirical evaluation demonstrates that musicPIIrate achieves state-of-the-art inference accuracy. The tool successfully infers a wide array of attributes, including: Demographics (Age, Country, Gender), Habits (Alcohol, Smoke, Sport), and Personality Traits (OCEAN scores). musicPIIrate outperforms existing methods, beating baselines in 9 out of 15 attribute inference tasks. To counter this vulnerability, we propose JamShield, a lightweight defensive framework. JamShield strategically injects dummy playlists into an account to dilute the PII-carrying signal. Our analysis indicates that JamShield represents a promising defense, lowering inference F1-scores by an average of 10%. This work provides an initial Offensive-AI benchmark for playlist-based PII inference using architectures that leverage set- and graph-structured data and introduces a defense showing encouraging mitigation effects.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。