arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.17567stat.MEstat.OT
收藏

高维稳健回归的迁移学习

Transfer Learning for High Dimensional Robust Regression

Xiaohui Yuan, Shujie Ren

AI总结:

本文提出基于Huber回归的稳健迁移学习方法,应对高维数据异方差性,并设计源数据集未知时的检测算法,通过模拟和超导体数据验证有效性。

摘要:

迁移学习已成为利用源数据集信息提升目标任务性能的关键技术。然而,在高维数据背景下,异方差性或协变量效应不均匀会导致异质性。为解决此问题,本文提出一种基于Huber回归的稳健迁移学习方法,专门针对可迁移源数据集已知的场景。该方法有效减轻了数据异方差性的影响,从而提高了估计和预测精度。此外,当可迁移源数据集未知时,本文引入了一种高效的检测算法来识别信息丰富的源。通过使用超导体数据的数值模拟和实证分析,证明了所提方法的有效性。

英文摘要:

Transfer learning has become an essential technique for utilizing information from source datasets to improve the performance of the target task. However, in the context of high-dimensional data, heterogeneity arises due to heteroscedastic variance or inhomogeneous covariate effects. To solve this problem, this paper proposes a robust transfer learning based on the Huber regression, specifically designed for scenarios where the transferable source data set is known. This method effectively mitigates the impact of data heteroscedasticity, leading to improvements in estimation and prediction accuracy. Moreover, when the transferable source data set is unknown, the paper introduces an efficient detection algorithm to identify informative sources. The effectiveness of the proposed method is proved through numerical simulation and empirical analysis using superconductor data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑