arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2205.08340stat.MLcs.AIcs.LGstat.ME
收藏

数据集偏移诊断的统一框架

A unified framework for dataset shift diagnostics

University of Michigan(密歇根大学);Federal University of São Carlos(圣卡洛斯联邦大学);Trustly;Experian LatAm DataLab(益博睿拉丁美洲数据实验室);University of São Paulo(圣保罗大学)

Felipe Maia Polo, Rafael Izbicki, Evanildo Gomes Lacerda, Juan Pablo Ibieta-Jimenez, Renato Vicente

AI总结:

本文提出DetectShift框架,通过统一测试统计量量化多种数据集偏移,适用于回归分类及多模态数据,在有限标注下提升预测器适应性。

摘要:

监督学习技术通常假设训练数据来自目标总体。然而在现实中,数据集偏移经常出现,如果未充分考虑,可能会降低预测器的性能。在本研究中,我们提出了一个新颖且灵活的框架DetectShift,用于量化和测试多种数据集偏移,包括$(X, Y)$、$X$、$Y$、$X|Y$和$Y|X$分布的偏移。DetectShift为从业者提供了对数据偏移的洞察,促进了使用源数据和目标数据对预测器进行适应或重训练。当目标领域的标注样本有限时,这显得极为宝贵。该框架利用具有相同性质的测试统计量来量化各种偏移的幅度,使结果更具可解释性。它具有通用性,适用于回归和分类任务,并适应多种数据形式——表格、文本或图像。实验结果表明,DetectShift在检测高维数据集偏移方面同样有效。

英文摘要:

Supervised learning techniques typically assume training data originates from the target population. Yet, in reality, dataset shift frequently arises, which, if not adequately taken into account, may decrease the performance of their predictors. In this work, we propose a novel and flexible framework called DetectShift that quantifies and tests for multiple dataset shifts, encompassing shifts in the distributions of $(X, Y)$, $X$, $Y$, $X|Y$, and $Y|X$. DetectShift equips practitioners with insights into data shifts, facilitating the adaptation or retraining of predictors using both source and target data. This proves extremely valuable when labeled samples in the target domain are limited. The framework utilizes test statistics with the same nature to quantify the magnitude of the various shifts, making results more interpretable. It is versatile, suitable for regression and classification tasks, and accommodates diverse data forms - tabular, text, or image. Experimental results demonstrate the effectiveness of DetectShift in detecting dataset shifts even in higher dimensions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑