arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.10522stat.AP
收藏

tsdataleaks:一个用于检测预测竞赛中潜在数据泄露的 R 包

tsdataleaks: An R Package to Detect Potential Data Leaks in Forecasting Competitions

Thiyanga S. Talagala

AI总结:

本文针对预测竞赛中的时间序列数据泄露问题,提出了R包tsdataleaks,提供简单高效的算法检测拼接、尺度偏移等数据泄露,并验证了其有效性。

摘要:

预测竞赛作为学习最佳实践和获取知识的手段,其重要性日益增加。数据泄露是竞赛中最常见的问题之一。当训练数据包含测试数据的信息时,就会发生数据泄露。时间序列数据的数据泄露可以通过多种不同的方式发生。例如:i) 随机选择的时间序列块被拼接形成新的时间序列;ii) 尺度偏移;iii) 时间序列中的重复模式;iv) 在原始时间序列中添加白噪声以形成新的时间序列等。本研究引入了一种检测这些数据泄露的新工具。tsdataleaks 包提供了一种简单且计算高效的算法来利用时间序列数据中的数据泄露。本文展示了该包的设计及其在预测竞赛数据应用中检测数据泄露的能力。

英文摘要:

Forecasting competitions are of increasing importance as a means to learn best practices and gain knowledge. Data leakage is one of the most common issues that can often be found in competitions. Data leaks can happen when the training data contains information about the test data. There are a variety of different ways that data leaks can occur with time series data. For example: i) randomly chosen blocks of time series are concatenated to form a new time series; ii) scale-shifts; iii) repeating patterns in time series; iv) white noise is added to the original time series to form a new time series, etc. This work introduces a novel tool to detect these data leaks. The tsdataleaks package provides a simple and computationally efficient algorithm to exploit data leaks in time series data. This paper demonstrates the package design and its power to detect data leakages with an application to forecasting competition data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑