通过贡献分析量化机器学习系统的透明度
Quantifying Transparency of Machine Learning Systems through Analysis of Contributions
摘要:
越来越多的机器学习(ML)模型被采用和部署到商业、医疗保健和其他组织流程中,将导致开发模型的工程师和研究人员与模型的用户和其他利益相关者(如监管机构或审计人员)之间的脱节。这种脱节是不可避免的,因为模型开始被使用多年,或者通过用户社区或商业市场在第三方之间共享,用户将越来越难以持续洞察创建模型的各方的适用性,或者用于训练模型的数据。这可能会成为问题,特别是在条例发生变化,曾经可以接受的标准变得过时,或者数据来源不可信,可能被认为是有意或无意地有偏见或损坏的情况下。在本文中,我们提出了一种方法,用于获得一个可量化的指标,该指标能够对用于生成ML模型和其他数据资产的流程管道的透明度进行排名,以便用户,审计员和其他利益相关者可以获得信心,他们将能够验证和信任他们依赖于其业务运营的系统中的数据源和人类贡献者。计算透明度指标的方法,以及可用于判断系统贡献可见度的标准类型,通过一个示例场景进行解释和说明。
英文摘要:
Increased adoption and deployment of machine learning (ML) models into business, healthcare and other organisational processes, will result in a growing disconnect between the engineers and researchers who developed the models and the model's users and other stakeholders, such as regulators or auditors. This disconnect is inevitable, as models begin to be used over a number of years or are shared among third parties through user communities or via commercial marketplaces, and it will become increasingly difficult for users to maintain ongoing insight into the suitability of the parties who created the model, or the data that was used to train it. This could become problematic, particularly where regulations change and once-acceptable standards become outdated, or where data sources are discredited, perhaps judged to be biased or corrupted, either deliberately or unwittingly. In this paper we present a method for arriving at a quantifiable metric capable of ranking the transparency of the process pipelines used to generate ML models and other data assets, such that users, auditors and other stakeholders can gain confidence that they will be able to validate and trust the data sources and human contributors in the systems that they rely on for their business operations. The methodology for calculating the transparency metric, and the type of criteria that could be used to make judgements on the visibility of contributions to systems are explained and illustrated through an example scenario.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。