arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.02358stat.MLcs.LG
收藏

通过条件分位数匹配进行迁移学习

Transfer Learning Through Conditional Quantile Matching

Yikun Zhang, Steven Wilkins-Reeves, Wesley Lee, Aude Hofleitner

AI总结:

通过条件分位数匹配进行迁移学习,利用异质源域提升数据稀缺目标域的预测性能。

摘要:

我们介绍了一种用于回归的迁移学习框架,该框架利用异质源域来提高数据稀缺的目标域的预测性能。我们的方法为每个源域分别学习一个条件生成模型,并通过条件分位数匹配校准生成的响应到目标域。这一分布对齐步骤在不假定协变量或标签偏移等限制性假设的情况下,纠正源域和目标域之间的普遍差异。所得到的框架为下游学习任务在目标域中的高质量数据增强提供了一种系统且灵活的方法。从理论角度来看,我们证明了在增强的数据集上训练的经验风险最小化(ERM)在温和条件下比仅在目标域上训练的ERM具有更紧的超额风险界。特别是,我们建立了新的收敛速率,这些速率支配了转移偏差-方差权衡。从实际角度来看,广泛的模拟和真实数据应用表明,所提出的方法在目标域上的一致性学习和竞争性迁移学习方法上均提高了预测准确性。

英文摘要:

We introduce a transfer learning framework for regression that leverages heterogeneous source domains to improve predictive performance in a data-scarce target domain. Our approach fits a conditional generative model to each source domain and calibrates a shared linear combination of the generated responses via conditional quantile matching at the observed target covariates. The calibration aligns the conditional response distributions while accommodating simultaneous shifts in both the covariate and conditional response distributions. The calibrated responses then serve as pseudo-labels to augment the target data for a broad class of downstream learning tasks. Theoretically, we derive an excess risk bound for an empirical risk minimizer (ERM) trained on the augmented data, separating the benefit of an enlarged training sample from errors due to density ratio estimation, source generator estimation, conditional calibration, and irreducible transfer bias. Empirically, simulations and real-data applications show that the proposed method can improve target-domain prediction when the transfer bias is small.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑