arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2202.05069stat.MLcs.LG
收藏

跨不同输入维度数据集的迁移学习:线性回归情形的算法与分析

Transfer-Learning Across Datasets with Different Input Dimensions: An Algorithm and Analysis for the Linear Regression Case

Vrije Universiteit Amsterdam(阿姆斯特丹自由大学)

Luis Pedro Silvestrin, Harry van Zanten, Mark Hoogendoorn, Ger Koole

AI总结:

针对不同输入维度的新数据与历史数据难以融合的问题,提出一种计算复杂度与普通最小二乘相当、无需调参的线性迁移学习算法,理论证明其鲁棒性优于仅用新数据的基线,在9个真实数据集上达SOTA。

摘要:

随着新型传感器和监测设备的发展,越来越多的数据源可作为机器学习模型的输入。这些数据一方面有助于提升模型精度,另一方面,将这些新输入与历史数据相结合仍是一个尚未得到充分研究的挑战。本研究提出一种迁移学习算法,可融合输入维度不同的新数据与历史数据。该方法易于实现、计算高效,计算复杂度与普通最小二乘法相当,且无需超参数调优,在新数据有限的场景下应用十分便捷。与其他方法不同的是,我们对其鲁棒性开展了严格的理论研究,证明其性能不会被仅使用新数据的基线方法超越。我们的方法在9个真实数据集上取得了当前最优性能,优于另一种线性迁移学习算法linear DSFT,且表现与non-linear DSFT相当。

英文摘要:

With the development of new sensors and monitoring devices, more sources of data become available to be used as inputs for machine learning models. These can on the one hand help to improve the accuracy of a model. On the other hand, combining these new inputs with historical data remains a challenge that has not yet been studied in enough detail. In this work, we propose a transfer learning algorithm that combines new and historical data with different input dimensions. This approach is easy to implement, efficient, with computational complexity equivalent to the ordinary least-squares method, and requires no hyperparameter tuning, making it straightforward to apply when the new data is limited. Different from other approaches, we provide a rigorous theoretical study of its robustness, showing that it cannot be outperformed by a baseline that utilizes only the new data. Our approach achieves state-of-the-art performance on 9 real-life datasets, outperforming the linear DSFT, another linear transfer learning algorithm, and performing comparably to non-linear DSFT.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑