DAGnosis:利用结构进行数据不一致性的局部化识别
DAGnosis: Localized Identification of Data Inconsistencies using Structures
AI总结:
本文提出 DAGnosis,用 DAG 编码训练数据的概率分布与特征独立性,以更准确检测部署样本的不一致性,并局部化解释其成因。
摘要:
在部署时识别并适当处理数据中的不一致性,对于可靠使用机器学习模型至关重要。尽管近期以数据为中心的方法能够相对于训练集识别此类不一致性,但它们存在两个关键局限:(1)在特征表现出统计独立性的场景中,由于使用压缩表示而效果欠佳;(2)缺乏局部化能力,无法准确指出某个样本为何可能被标记为不一致,而这对于指导未来的数据收集十分重要。我们利用有向无环图(DAG)将训练集特征的概率分布和独立性编码为结构,从而解决这两个根本局限。我们的方法名为 DAGnosis,利用这些结构性交互得出有价值且富有洞见的、以数据为中心的结论。DAGnosis 实现了在 DAG 上对不一致性原因的局部化,这是以往方法忽视的方面。此外,我们通过实验表明,利用这些交互(1)能在检测不一致性时得出更准确的结论,并且(2)能针对某些样本为何被标记提供更详细的洞见。
英文摘要:
Identification and appropriate handling of inconsistencies in data at deployment time is crucial to reliably use machine learning models. While recent data-centric methods are able to identify such inconsistencies with respect to the training set, they suffer from two key limitations: (1) suboptimality in settings where features exhibit statistical independencies, due to their usage of compressive representations and (2) lack of localization to pin-point why a sample might be flagged as inconsistent, which is important to guide future data collection. We solve these two fundamental limitations using directed acyclic graphs (DAGs) to encode the training set's features probability distribution and independencies as a structure. Our method, called DAGnosis, leverages these structural interactions to bring valuable and insightful data-centric conclusions. DAGnosis unlocks the localization of the causes of inconsistencies on a DAG, an aspect overlooked by previous approaches. Moreover, we show empirically that leveraging these interactions (1) leads to more accurate conclusions in detecting inconsistencies, as well as (2) provides more detailed insights into why some samples are flagged.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。