arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.01830stat.MLcs.LG
收藏

动态组合预测中的模型压缩

Model Compression for Dynamic Forecast Combination

Dalhousie University(达尔豪斯大学);Fraunhofer AICOS Portugal(弗劳恩霍夫AICOS葡萄牙研究所);INESC TEC;University of Porto(波尔图大学);Télécom ParisTech(巴黎高等电信学校);University of Waikato(怀卡托大学)

Vitor Cerqueira, Luis Torgo, Carlos Soares, Albert Bifet

摘要:

组合几种不同预测模型的预测优势已被广泛接受。特别是在时间序列预测问题中,这种组合通常是动态的,以应对数据中存在的潜在非平稳变化源。尽管集成方法具有优越的预测性能,但它们存在两个主要限制:高计算成本和缺乏透明度。这些问题往往妨碍采用这种办法,而采用更简单但更有效和可靠的办法。在本文中,我们利用模型压缩的想法来解决这个问题,在时间序列预测任务。模型压缩方法在预测中大多未被探索。由于数据的演变性质,将其应用于时间序列具有挑战性。此外,虽然文献集中在神经网络,我们将模型压缩应用于不同类型的方法。在一组广泛的实验中,我们表明,压缩动态预测集成到一个单独的模型导致可比的预测性能和大幅降低计算成本。此外,具有最佳平均秩的压缩个体模型是基于规则的回归模型。因此,模型压缩还导致模型可解释性方面的益处。本文所做的实验是完全可重复的。

英文摘要:

The predictive advantage of combining several different predictive models is widely accepted. Particularly in time series forecasting problems, this combination is often dynamic to cope with potential non-stationary sources of variation present in the data. Despite their superior predictive performance, ensemble methods entail two main limitations: high computational costs and lack of transparency. These issues often preclude the deployment of such approaches, in favour of simpler yet more efficient and reliable ones. In this paper, we leverage the idea of model compression to address this problem in time series forecasting tasks. Model compression approaches have been mostly unexplored for forecasting. Their application in time series is challenging due to the evolving nature of the data. Further, while the literature focuses on neural networks, we apply model compression to distinct types of methods. In an extensive set of experiments, we show that compressing dynamic forecasting ensembles into an individual model leads to a comparable predictive performance and a drastic reduction in computational costs. Further, the compressed individual model with best average rank is a rule-based regression model. Thus, model compression also leads to benefits in terms of model interpretability. The experiments carried in this paper are fully reproducible.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑