arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1812.04597stat.MLcs.AIcs.LG
收藏

防止由于数据集转移而导致的故障:学习传输数据的预测模型

Preventing Failures Due to Dataset Shift: Learning Predictive Models That Transport

Johns Hopkins University(约翰斯·霍普金斯大学)

Adarsh Subbaswamy, Peter Schulam, Suchi Saria

摘要:

当训练和目标分布不同时,经典的监督学习会产生不可靠的模型,大多数现有的解决方案需要来自目标域的样本。我们提出了一种积极主动的方法,学习的关系,在训练域,将概括到目标域,通过将先验知识的数据生成过程中,预计会有所不同,在因果选择图中表示。具体来说,我们从联合分解中删除了不稳定机制产生的变量,以产生手术估计-一种对环境差异不变的介入分布。我们证明了手术估计发现稳定的关系,严格的情况下比以前的方法,只考虑条件关系,并证明了这一点在模拟实验。我们还评估真实世界的数据,其中真正的因果关系图是未知的,执行竞争对手完全数据驱动的方法。

英文摘要:

Classical supervised learning produces unreliable models when training and target distributions differ, with most existing solutions requiring samples from the target domain. We propose a proactive approach which learns a relationship in the training domain that will generalize to the target domain by incorporating prior knowledge of aspects of the data generating process that are expected to differ as expressed in a causal selection diagram. Specifically, we remove variables generated by unstable mechanisms from the joint factorization to yield the Surgery Estimator---an interventional distribution that is invariant to the differences across environments. We prove that the surgery estimator finds stable relationships in strictly more scenarios than previous approaches which only consider conditional relationships, and demonstrate this in simulated experiments. We also evaluate on real world data for which the true causal diagram is unknown, performing competitively against entirely data-driven approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑