GRAIMATTER绿皮书:可信研究环境(TRE)中训练的机器学习(ML)模型的披露控制建议
GRAIMATTER Green Paper: Recommendations for disclosure control of trained Machine Learning (ML) models from Trusted Research Environments (TREs)
摘要:
TREs被广泛使用,并越来越多地用于支持跨一系列部门的敏感数据的统计分析(例如,卫生、警察、税务和教育),因为它们可以实现安全和透明的研究,同时保护数据机密性。学术界和工业界越来越希望在TREs中训练AI模型。人工智能领域正在快速发展,其应用包括发现人为错误,简化流程,任务自动化和决策支持。这些复杂的人工智能模型需要更多的信息来描述和复制,这增加了从这些描述中推断敏感个人数据的可能性。TREs没有针对这些风险的成熟流程和控制措施。这是一个复杂的话题,期望所有TRE都意识到所有风险,或者TRE研究人员已经在AI特定培训中解决了这些风险,这是不合理的。GRAIMATTER已经为TREs开发了一套可用的建议草案,以防范TREs在披露经过训练的AI模型时的额外风险。这些建议的制定得到了GRAIMATTER UKRI DARE UK sprint研究项目的资助。我们的建议的此版本于2022年9月项目结束时发布。在该项目的过程中,我们确定了许多领域,供今后进行调查,以便在实践中扩大和检验这些建议。因此,我们预计这份文件将随着时间的推移而发展。
英文摘要:
TREs are widely, and increasingly used to support statistical analysis of sensitive data across a range of sectors (e.g., health, police, tax and education) as they enable secure and transparent research whilst protecting data confidentiality. There is an increasing desire from academia and industry to train AI models in TREs. The field of AI is developing quickly with applications including spotting human errors, streamlining processes, task automation and decision support. These complex AI models require more information to describe and reproduce, increasing the possibility that sensitive personal data can be inferred from such descriptions. TREs do not have mature processes and controls against these risks. This is a complex topic, and it is unreasonable to expect all TREs to be aware of all risks or that TRE researchers have addressed these risks in AI-specific training. GRAIMATTER has developed a draft set of usable recommendations for TREs to guard against the additional risks when disclosing trained AI models from TREs. The development of these recommendations has been funded by the GRAIMATTER UKRI DARE UK sprint research project. This version of our recommendations was published at the end of the project in September 2022. During the course of the project, we have identified many areas for future investigations to expand and test these recommendations in practice. Therefore, we expect that this document will evolve over time.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。