CODA:通过概念漂移模拟器实现时域泛化
CODA: Temporal Domain Generalization via Concept Drift Simulator
AI总结:
针对机器学习模型因概念漂移易过时且现有方法多依赖特定模型的问题,提出模型无关的CODA框架,通过预测特征相关矩阵模拟未来数据训练模型,有效实现跨架构时域泛化。
摘要:
在实际应用中,机器学习模型常因潜在时间趋势导致的联合分布偏移而过时,这种现象被称为“概念漂移”。现有研究提出了针对特定模型的策略,以在近未来域中实现时间泛化。然而,真实世界数据集的多样特性要求定制化的预测模型架构。为此,迫切需要一种模型无关的时域泛化方法,以在不同数据模态和架构间保持通用性。在本研究中,我们旨在从以数据为中心的视角解决概念漂移问题,从而无需考虑数据与模型之间的交互。开发此类框架面临着显著挑战:(i)现有生成模型难以生成分布外的未来数据;(ii)精确捕捉沿时间顺序源域的联合分布时间趋势在计算上不可行。为应对这些挑战,我们提出了概念漂移模拟器(CODA)框架,该框架引入预测特征相关矩阵来模拟未来数据以用于模型训练。具体而言,CODA利用特征相关性来表示特定时间点的数据特征,从而规避了高昂的计算成本。实验结果表明,使用CODA生成的数据作为训练输入,可在不同模型架构下有效实现时域泛化。
英文摘要:
In real-world applications, machine learning models often become obsolete due to shifts in the joint distribution arising from underlying temporal trends, a phenomenon known as the "concept drift". Existing works propose model-specific strategies to achieve temporal generalization in the near-future domain. However, the diverse characteristics of real-world datasets necessitate customized prediction model architectures. To this end, there is an urgent demand for a model-agnostic temporal domain generalization approach that maintains generality across diverse data modalities and architectures. In this work, we aim to address the concept drift problem from a data-centric perspective to bypass considering the interaction between data and model. Developing such a framework presents non-trivial challenges: (i) existing generative models struggle to generate out-of-distribution future data, and (ii) precisely capturing the temporal trends of joint distribution along chronological source domains is computationally infeasible. To tackle the challenges, we propose the COncept Drift simulAtor (CODA) framework incorporating a predicted feature correlation matrix to simulate future data for model training. Specifically, CODA leverages feature correlations to represent data characteristics at specific time points, thereby circumventing the daunting computational costs. Experimental results demonstrate that using CODA-generated data as training input effectively achieves temporal domain generalization across different model architectures.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。