arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2002.01605cs.LGcs.AIstat.ML
收藏

存在未知未知数的探索式机器学习

Exploratory Machine Learning with Unknown Unknowns

Nanjing University(南京大学)

Peng Zhao, Jia-Wei Shan, Yu-Jie Zhang, Zhi-Hua Zhou

AI总结:

本文针对训练数据中存在被误认为已知标签的未知类别问题,提出探索式机器学习方法,通过主动扩展特征空间发现隐藏类别,包含拒绝模型、特征探索和模型级联三个要素,并从理论和实验上验证了其有效性。

摘要:

在传统监督学习中,训练数据集包含来自已知标签集的真实标签,学习到的模型会将未见实例分类到已知标签中。本文研究了一个新的问题设定:训练数据中存在被误认为其他标签的未知类别,因此在给定的监督下它们的存在显得未知。我们将未知未知数归因于由于特征信息不足,训练数据集因不完整感知的标签空间而受到不良指导。为此,我们提出了探索式机器学习,通过主动扩展特征空间来检查和调查训练数据,以发现潜在的隐藏类别。我们的方法包含三个要素:拒绝模型、特征探索和模型级联。我们提供了理论分析来证明其优越性,并在合成和真实数据集上验证了其有效性。

英文摘要:

In conventional supervised learning, a training dataset is given with ground-truth labels from a known label set, and the learned model will classify unseen instances to known labels. This paper studies a new problem setting in which there are unknown classes in the training data misperceived as other labels, and thus their existence appears unknown from the given supervision. We attribute the unknown unknowns to the fact that the training dataset is badly advised by the incompletely perceived label space due to the insufficient feature information. To this end, we propose the exploratory machine learning, which examines and investigates training data by actively augmenting the feature space to discover potentially hidden classes. Our method consists of three ingredients including rejection model, feature exploration, and model cascade. We provide theoretical analysis to justify its superiority, and validate the effectiveness on both synthetic and real datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑