arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.02667stat.MLcs.LG
收藏

机器学习中的非分布泛化

Out of Distribution Generalization in Machine Learning

New York University(纽约大学)

Martin Arjovsky

摘要:

近年来,机器学习在各个领域取得了巨大的成功。然而,许多成功的案例都发生在训练和测试分布非常相似的地方。在日常情况下,当模型在与训练数据略有不同的数据中进行测试时,ML算法可能会失败。本研究试图正式定义这个问题,在我们的数据中做出哪些假设是合理的,以及我们希望从中获得什么样的保证。然后,我们专注于某一类的分布问题,他们的假设,并介绍简单的算法,遵循这些假设,能够提供更可靠的推广。论文的一个中心主题是发现数据的因果结构,找到可靠的特征(当使用它们来预测时),无论它们的上下文如何,以及分布泛化之间的紧密联系。

英文摘要:

Machine learning has achieved tremendous success in a variety of domains in recent years. However, a lot of these success stories have been in places where the training and the testing distributions are extremely similar to each other. In everyday situations when models are tested in slightly different data than they were trained on, ML algorithms can fail spectacularly. This research attempts to formally define this problem, what sets of assumptions are reasonable to make in our data and what kind of guarantees we hope to obtain from them. Then, we focus on a certain class of out of distribution problems, their assumptions, and introduce simple algorithms that follow from these assumptions that are able to provide more reliable generalization. A central topic in the thesis is the strong link between discovering the causal structure of the data, finding features that are reliable (when using them to predict) regardless of their context, and out of distribution generalization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑