arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2305.15696cs.LG
收藏

通过k-最近邻检测数据集漂移与非独立同分布采样

Detecting Dataset Drift and Non-IID Sampling via k-Nearest Neighbors

MIT(麻省理工学院);Cleanlab

Jesse Cummings, Elías Snorrason, Jonas Mueller

AI总结:

本文提出一种基于k-最近邻的统计检验方法,用于检测数据集中的分布漂移和非独立同分布采样问题,适用于多种数据类型,并能发现比现有方法更广泛的IID违反情况。

摘要:

我们提出了一种直接的统计检验方法,用于检测数据满足独立同分布(IID)假设的某些违反情况。所考虑的具体违反形式在实际应用中很常见:数据集中的样本是否以几乎相邻的样本往往具有更相似特征值的方式排列(例如由于分布漂移或数据点之间的吸引性相互作用)。基于k-最近邻估计,我们的方法可用于审计任何多元数值数据,以及可以通过数值表示的其他数据类型(图像、文本、音频等),例如使用模型嵌入表示的数据。与现有的检测漂移或自相关的方法相比,我们的方法既适用于更多类型的数据,又能在实践中检测出更广泛的IID违反情况。代码:https://github.com/cleanlab/cleanlab

英文摘要:

We present a straightforward statistical test to detect certain violations of the assumption that the data are Independent and Identically Distributed (IID). The specific form of violation considered is common across real-world applications: whether the examples are ordered in the dataset such that almost adjacent examples tend to have more similar feature values (e.g. due to distributional drift, or attractive interactions between datapoints). Based on a k-Nearest Neighbors estimate, our approach can be used to audit any multivariate numeric data as well as other data types (image, text, audio, etc.) that can be numerically represented, perhaps with model embeddings. Compared with existing methods to detect drift or auto-correlation, our approach is both applicable to more types of data and also able to detect a wider variety of IID violations in practice. Code: https://github.com/cleanlab/cleanlab

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑