arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.21689stat.ME
收藏

跨语义迁移学习用于高维线性回归

Cross-Semantic Transfer Learning for High-Dimensional Linear Regression

Great Bay University(大湾区大学);Southern University of Science and Technology(南方科技大学)

Jiancheng Jiang, Xuejun Jiang, Hongxia Jin

AI总结:

本文提出跨语义迁移学习框架,通过加权融合惩罚和ADMM实现高维线性回归的跨领域迁移,理论证明其在温和条件下能实现Oracle估计器,实验证明在跨语义和部分信号相似性场景中性能优于现有方法。

摘要:

当前高维线性回归的迁移学习方法假设领域间特征对齐,限制了其在语义匹配特征上的适用性。然而在许多现实场景中,目标领域和源领域中的不同特征可能具有相似的预测作用,形成一种跨语义相似性。为利用这种更广泛的迁移性,我们提出了跨语义迁移学习(CSTL)框架。该框架通过将每个目标系数与所有源系数进行比较,通过加权融合惩罚来捕捉潜在关系。权重来源于SCAD惩罚的导数,有效近似出一种理想加权方案,保留可迁移信号的同时过滤掉源特定噪声。为提高计算效率,我们采用交替方向乘子法(ADMM)实现CSTL。理论上,我们证明在温和条件下,CSTL以高概率实现Oracle估计器。模拟实验和实际数据应用的结果表明,CSTL在跨语义和部分信号相似性设置中均优于现有方法。

英文摘要:

Current transfer learning methods for high-dimensional linear regression assume feature alignment across domains, restricting their applicability to semantically matched features. In many real-world scenarios, however, distinct features in the target and source domains can play similar predictive roles, creating a form of cross-semantic similarity. To leverage this broader transferability, we propose the Cross-Semantic Transfer Learning (CSTL) framework. It captures potential relationships by comparing each target coefficient with all source coefficients through a weighted fusion penalty. The weights are derived from the derivative of the SCAD penalty, effectively approximating an ideal weighting scheme that preserves transferable signals while filtering out source-specific noise. For computational efficiency, we implement CSTL using the Alternating Direction Method of Multipliers (ADMM). Theoretically, we establish that under mild conditions, CSTL achieves the oracle estimator with overwhelming probability. Empirical results from simulations and a real-data application confirm that CSTL outperforms existing methods in both cross-semantic and partial signal similarity settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑