Tsformer:旅游需求预测的时间序列Transformer
Tsformer: Time series Transformer for tourism demand forecasting
摘要:
基于人工智能的方法已被广泛应用于旅游需求预测。然而,目前基于人工智能的方法缺乏处理长期依赖的能力,并且大多数方法缺乏可解释性。最初用于机器翻译的Transformer显示出令人难以置信的长期依赖处理能力。在Transformer的基础上,提出了一种基于编码器-解码器结构的时间序列Transformer(Tsformer)旅游需求预测方法。Tsformer通过编码器对长期依赖进行编码,通过解码器捕获短期依赖,并通过一系列注意掩蔽机制在突出主导注意的前提下简化注意交互。这些改进使得多头注意力机制根据时间关系处理输入序列,有助于更好的可解释性。更重要的是,编码器-解码器架构的上下文处理能力允许采用要预测的日历来增强预测性能。在九寨沟和四姑娘山旅游需求数据集上与其他9种基线方法进行的实验表明,所提出的Tsformer模型在短期和长期旅游需求预测任务中均优于所有基线模型。此外,烧蚀研究表明,通过日历的日子被预测有助于建议Tsformer的预测性能。为了更好地解释,注意力权重矩阵可视化。结果表明,在短期预报中,转换器主要关注季节特征和与待预报日相近的天数。
英文摘要:
AI-based methods have been widely applied to tourism demand forecasting. However, current AI-based methods are short of the ability to process long-term dependency, and most of them lack interpretability. The Transformer used initially for machine translation shows an incredible ability to long-term dependency processing. Based on the Transformer, we proposed a time series Transformer (Tsformer) with Encoder-Decoder architecture for tourism demand forecasting. The proposed Tsformer encodes long-term dependency with encoder, captures short-term dependency with decoder, and simplifies the attention interactions under the premise of highlighting dominant attention through a series of attention masking mechanisms. These improvements make the multi-head attention mechanism process the input sequence according to the time relationship, contributing to better interpretability. What's more, the context processing ability of the Encoder-Decoder architecture allows adopting the calendar of days to be forecasted to enhance the forecasting performance. Experiments conducted on the Jiuzhaigou valley and Siguniang mountain tourism demand datasets with other nine baseline methods indicate that the proposed Tsformer outperformed all baseline models in the short-term and long-term tourism demand forecasting tasks. Moreover, ablation studies demonstrate that the adoption of the calendar of days to be forecasted contributes to the forecasting performance of the proposed Tsformer. For better interpretability, the attention weight matrix visualization is performed. It indicates that the Tsformer concentrates on seasonal features and days close to days to be forecast in short-term forecasting.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。