arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.08000cs.LGcs.AIcs.HC
收藏

图像数据中协变量偏移的对比识别

Contrastive Identification of Covariate Shift in Image Data

Oregon State University(俄勒冈州立大学)

Matthew L. Olson, Thuy-Vy Nguyen, Gaurav Dixit, Neale Ratzlaff, Weng-Keen Wong, Minsuk Kahng

摘要:

识别协变量偏移对于使机器学习系统在现实世界中具有鲁棒性以及检测未反映在测试数据中的训练数据偏差至关重要。然而,检测协变量偏移是具有挑战性的,特别是当数据由高维图像组成时,以及当多种类型的局部协变量偏移影响数据的不同子空间时。虽然自动化技术可以用来检测协变量偏移的存在,我们的目标是帮助人类用户的特点的程度协变量偏移在大型图像数据集的接口,无缝集成从检测算法获得的信息。在本文中,我们设计和评估一个新的可视化界面,便于比较的局部分布的训练和测试数据。我们对多属性面部数据进行了定量用户研究,以比较两种不同的学习低维潜在表示(预训练的ImageNet CNN与密度比)和两种用户分析工作流程(最近邻与聚类)。我们的研究结果表明,我们的密度比模型的潜在表示,结合最近邻比较,是最有效的帮助人类识别协变量偏移。

英文摘要:

Identifying covariate shift is crucial for making machine learning systems robust in the real world and for detecting training data biases that are not reflected in test data. However, detecting covariate shift is challenging, especially when the data consists of high-dimensional images, and when multiple types of localized covariate shift affect different subspaces of the data. Although automated techniques can be used to detect the existence of covariate shift, our goal is to help human users characterize the extent of covariate shift in large image datasets with interfaces that seamlessly integrate information obtained from the detection algorithms. In this paper, we design and evaluate a new visual interface that facilitates the comparison of the local distributions of training and test data. We conduct a quantitative user study on multi-attribute facial data to compare two different learned low-dimensional latent representations (pretrained ImageNet CNN vs. density ratio) and two user analytic workflows (nearest-neighbor vs. cluster-to-cluster). Our results indicate that the latent representation of our density ratio model, combined with a nearest-neighbor comparison, is the most effective at helping humans identify covariate shift.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑