BlackCATT: 联邦学习中基于黑盒的 collusion 意识追踪
BlackCATT: Black-box Collusion Aware Traitor Tracing in Federated Learning
AI总结:
BlackCATT 是一种针对联邦学习中黑盒 collusion 抵抗的叛徒追踪方法,通过迭代优化触发器提升追踪性能,并引入功能正则化以解决模型更新不兼容问题。
摘要:
联邦学习近年来因其在涉及个人或敏感数据的应用中受到欢迎,因为它允许通过数据所有者所在地的本地更新协同训练机器学习模型,而无需共享数据本身。考虑到数据所有者可能泄露或滥用数据的风险,许多研究试图保护其版权,甚至通过唯一水印标识每个参与者的模型副本来追踪潜在泄露的来源。现实中的指控场景要求黑盒设置,其中水印通常嵌入为一组样本-标签对。然而, collusion 的威胁,即多个恶意行为者合谋产生不可追踪的模型,却很少被提及,先前的工作局限于浅层网络和近线性可分的主要任务。据我们所知,这项工作是首次提出一种通用的 collusion 抵抗嵌入方法,用于联邦学习中的黑盒叛徒追踪:BlackCATT,它引入了一个新的 collusion 意识嵌入损失项,并且不使用固定的触发集,而是迭代优化触发器以帮助收敛和叛徒追踪性能。实验结果证实了所提出方案在不同架构和数据集上的有效性。此外,对于在主要任务上学习不同水印后可能遭受更新不兼容的模型(例如包含批量归一化层的架构),我们提出的 BlackCATT+FR 通过在聚合器中使用一组辅助示例引入功能正则化,促进模型副本之间的共享特征空间,而不会影响叛徒追踪性能。
英文摘要:
Federated Learning has been popularized in recent years for applications involving personal or sensitive data, as it allows the collaborative training of machine learning models through local updates at the data-owners' premises, which does not require the sharing of the data itself. Considering the risk of leakage or misuse by any of the data-owners, many works attempt to protect their copyright, or even trace the origin of a potential leak through unique watermarks identifying each participant's model copy. Realistic accusation scenarios impose a black-box setting, where watermarks are typically embedded as a set of sample-label pairs. The threat of collusion, however, where multiple bad actors conspire together to produce an untraceable model, has been rarely addressed, and previous works have been limited to shallow networks and near-linearly separable main tasks. To the best of our knowledge, this work is the first to present a general collusion-resistant embedding method for black-box traitor tracing in Federated Learning: BlackCATT, which introduces a novel collusion-aware embedding loss term and, instead of using a fixed trigger set, iteratively optimizes the triggers to aid convergence and traitor tracing performance. Experimental results confirm the efficacy of the proposed scheme across different architectures and datasets. Furthermore, for models that would otherwise suffer from update incompatibility on the main task after learning different watermarks (e.g., architectures including batch normalization layers), our proposed BlackCATT+FR incorporates functional regularization through a set of auxiliary examples at the aggregator, promoting a shared feature space among model copies without compromising traitor tracing performance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。