arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2002.05660cs.LGstat.ML
收藏

Learn to Expect the Unexpected: Probably Approximately Correct Domain Generalization

MIT(麻省理工学院);Microsoft Research(微软研究院);Hebrew University(希伯来大学);University of Minnesota(明尼苏达大学)

Vikas K. Garg, Adam Kalai, Katrina Ligett, Zhiwei Steven Wu

英文摘要:

Domain generalization is the problem of machine learning when the training data and the test data come from different data domains. We present a simple theoretical model of learning to generalize across domains in which there is a meta-distribution over data distributions, and those data distributions may even have different supports. In our model, the training data given to a learning algorithm consists of multiple datasets each from a single domain drawn in turn from the meta-distribution. We study this model in three different problem settings---a multi-domain Massart noise setting, a decision tree multi-dataset setting, and a feature selection setting, and find that computationally efficient, polynomial-sample domain generalization is possible in each. Experiments demonstrate that our feature selection algorithm indeed ignores spurious correlations and improves generalization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑