arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.01451cs.CRcs.DBcs.LG
收藏

增强联邦学习系统中的数据溯源与模型透明度——一种数据库方法

Enhancing Data Provenance and Model Transparency in Federated Learning Systems -- A Database Approach

University of Washington(华盛顿大学)

Michael Gu, Ramasoumya Naraparaju, Dongfang Zhao

AI总结:

本文提出结合密码哈希、客户端模型快照与数据库子系统的数据解耦联邦学习框架,以低计算开销增强数据溯源、模型透明度、可复现性与可信性。

摘要:

联邦学习(Federated Learning,FL)为在去中心化边缘设备上训练机器学习模型同时保护数据隐私提供了一种富有前景的范式。然而,在这些分布式环境中确保数据的完整性和可追溯性仍是一项关键挑战。创建透明人工智能的能力,例如详细说明机器学习模型的训练过程,因其使用大量敏感的(超)参数而成为日益突出的关注点;因此,必须在开放性与保护敏感信息的需求之间达成合理平衡。在本文中,我们提出了最早旨在增强联邦学习系统中数据溯源和模型透明度的方法之一。我们的方法结合密码学技术和高效的模型管理,以追踪数据在整个FL过程中的转换,并力求提高已训练FL模型的可复现性和可信性。我们通过在多种FL场景下的实验评估证明了该方法的有效性,展示了其全面处理问责性和可解释性的能力。研究结果表明,通过在我们提出的数据解耦FL设计中存储链式密码哈希和客户端模型快照,该系统能够显著增强各种FL环境中的数据透明度。这一成果还得益于采用多种优化技术,从而在不带来显著计算负载的情况下实现全面的数据溯源。大量实验结果表明,将数据库子系统集成到联邦学习系统中可以高效改善数据溯源,促进安全FL在隐私敏感应用中的采用,并为未来FL透明度和安全特性的进步铺平道路。

英文摘要:

Federated Learning (FL) presents a promising paradigm for training machine learning models across decentralized edge devices while preserving data privacy. Ensuring the integrity and traceability of data across these distributed environments, however, remains a critical challenge. The ability to create transparent artificial intelligence, such as detailing the training process of a machine learning model, has become an increasingly prominent concern due to the large number of sensitive (hyper)parameters it utilizes; thus, it is imperative to strike a reasonable balance between openness and the need to protect sensitive information. In this paper, we propose one of the first approaches to enhance data provenance and model transparency in federated learning systems. Our methodology leverages a combination of cryptographic techniques and efficient model management to track the transformation of data throughout the FL process, and seeks to increase the reproducibility and trustworthiness of a trained FL model. We demonstrate the effectiveness of our approach through experimental evaluations on diverse FL scenarios, showcasing its ability to tackle accountability and explainability across the board. Our findings show that our system can greatly enhance data transparency in various FL environments by storing chained cryptographic hashes and client model snapshots in our proposed design for data decoupled FL. This is made possible by also employing multiple optimization techniques which enables comprehensive data provenance without imposing substantial computational loads. Extensive experimental results suggest that integrating a database subsystem into federated learning systems can improve data provenance in an efficient manner, encouraging secure FL adoption in privacy-sensitive applications and paving the way for future advancements in FL transparency and security features.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑