It is widely known that Google Trends have become one of the most popular free tools used by forecasters both in academics and in the private and public sectors. There are many papers, from several different fields, concluding that Google Trends improve forecasts' accuracy. However, what seems to be widely unknown, is that each sample of Google search data is different from the other, even if you set the same search term, data and location. This means that it is possible to find arbitrary conclusions merely by chance. This paper aims to show why and when it can become a problem and how to overcome this obstacle.
Being able to model and forecast international migration as precisely as possible is crucial for policymaking. Recently Google Trends data in addition to other economic and demographic data have been shown to improve the forecasting quality of a gravity linear model for the one-year ahead forecasting. In this work, we replace the linear model with a long short-term memory (LSTM) approach and compare it with two existing approaches: the linear gravity model and an artificial neural network (ANN) model. Our LSTM approach combined with Google Trends data outperforms both these models on various m…
The University of Queensland（昆士兰大学）；Zhejiang University（浙江大学）；Chongqing University（重庆大学）；Purdue University（普渡大学）
Multivariate time series forecasting is widely used in various fields. Reasonable prediction results can assist people in planning and decision-making, generate benefits and avoid risks. Normally, there are two characteristics of time series, that is, long-term trend and short-term fluctuation. For example, stock prices will have a long-term upward trend with the market, but there may be a small decline in the short term. These two characteristics are often relatively independent of each other. However, the existing prediction methods often do not distinguish between them, which reduces the ac…
African Institute for Mathematical Sciences, Rwanda（卢旺达非洲数学科学研究所）；Institute of Applied Statistics, University of Burundi（布隆迪大学应用统计研究所）
Air pollution is a major public health problem worldwide although the lack of data is a global issue for most low and middle income countries. Ambient air pollution in the form of fine particulate matter (PM2.5) exceeds the World Health Organization guidelines in Rwanda with a daily average of around 42.6 microgram per meter cube. Monitoring and mitigation strategies require an expensive investment in equipment to collect pollution data. Low-cost sensor technology and machine learning methods have appeared as an alternative solution to get reliable information for decision making. This paper a…
Sun Yat-sen University（中山大学）；Microsoft Research（微软研究院）
Stock trend forecasting, which forecasts stock prices' future trends, plays an essential role in investment. The stocks in a market can share information so that their stock prices are highly correlated. Several methods were recently proposed to mine the shared information through stock concepts (e.g., technology, Internet Retail) extracted from the Web to improve the forecasting results. However, previous work assumes the connections between stocks and concepts are stationary, and neglects the dynamic relevance between stocks and concepts, limiting the forecasting results. Moreover, existing …
Ivan Franko National University of Lviv（利沃夫伊万·弗兰科国立大学）
The paper describes the deep learning approach for forecasting non-stationary time series with using time trend correction in a neural network model. Along with the layers for predicting sales values, the neural network model includes a subnetwork block for the prediction weight for a time trend term which is added to a predicted sales value. The time trend term is considered as a product of the predicted weight value and normalized time value. The results show that the forecasting accuracy can be essentially improved for non-stationary sales with time trends using the trend correction block i…
UC San Diego（加州大学圣地亚哥分校）；AWS AI Labs（亚马逊云科技人工智能实验室）；AWS（亚马逊云科技）
Transformer-based models have gained large popularity and demonstrated promising results in long-term time-series forecasting in recent years. In addition to learning attention in time domain, recent works also explore learning attention in frequency domains (e.g., Fourier domain, wavelet domain), given that seasonal patterns can be better captured in these domains. In this work, we seek to understand the relationships between attention models in different time and frequency domains. Theoretically, we show that attention models in different domains are equivalent under linear conditions (i.e.,…
National University of Singapore（新加坡国立大学）；Shenzhen University（深圳大学）；The Hong Kong Polytechnic University（香港理工大学）；ETRI（韩国电子通信研究院）；UST（韩国科学技术联合大学院大学）；National Yang Ming Chiao Tung University（阳明交通大学）
This companion paper supports the replication of the fashion trend forecasting experiments with the KERN (Knowledge Enhanced Recurrent Network) method that we presented in the ICMR 2020. We provide an artifact that allows the replication of the experiments using a Python implementation. The artifact is easy to deploy with simple installation, training and evaluation. We reproduce the experiments conducted in the original paper and obtain similar performance as previously reported. The replication results of the experiments support the main claims in the original paper.
School of Computer Science and Engineering, Sun Yat-sen University（中山大学计算机科学与工程学院）；Microsoft Research Asia（微软亚洲研究院）；School of Artificial Intelligence, Sun Yat-sen University（中山大学人工智能学院）
Stock trend forecasting, aiming at predicting the stock future trends, is crucial for investors to seek maximized profits from the stock market. Many event-driven methods utilized the events extracted from news, social media, and discussion board to forecast the stock trend in recent years. However, existing event-driven methods have two main shortcomings: 1) overlooking the influence of event information differentiated by the stock-dependent properties; 2) neglecting the effect of event information from other related stocks. In this paper, we propose a relational event-driven stock trend fore…
TA-SparseMG: Trend-Aware Sparse Forecasting via Multi-Scale Gating for Long-Term Time Series
School of Mathematical Sciences, Guizhou Normal University（贵州师范大学数学科学学院）；School of Big Data and Computer Science, Guizhou Normal University（贵州师范大学大数据与计算机科学学院）
Peking University（北京大学）；Microsoft Research Asia（微软亚洲研究院）
Stock trend forecasting has become a popular research direction that attracts widespread attention in the financial field. Though deep learning methods have achieved promising results, there are still many limitations, for example, how to extract clean features from the raw stock data. In this paper, we introduce an \emph{Augmented Disentanglement Distillation (ADD)} approach to remove interferential features from the noised raw data. Specifically, we present 1) a disentanglement structure to separate excess and market information from the stock data to avoid the two factors disturbing each ot…
A major source of information can be taken from financial news articles, which have some correlations about the fluctuation of stock trends. In this paper, we investigate the influences of financial news on the stock trends, from a multi-instance view. The intuition behind this is based on the news uncertainty of varying intervals of news occurrences and the lack of annotation in every single financial news. Under the scenario of Multiple Instance Learning (MIL) where training instances are arranged in bags, and a label is assigned for the entire bag instead of instances, we develop a flexible…
Online advertising revenues account for an increasing share of publishers' revenue streams, especially for small and medium-sized publishers who depend on the advertisement networks of tech companies such as Google and Facebook. Thus publishers may benefit significantly from accurate online advertising revenue forecasts to better manage their website monetization strategies. However, publishers who only have access to their own revenue data lack a holistic view of the total ad market of publishers, which in turn limits their ability to generate insights into their own future online advertising…
Demand forecasting applications have immensely benefited from the state-of-the-art Deep Learning methods used for time series forecasting. Traditional uni-modal models are predominantly seasonality driven which attempt to model the demand as a function of historic sales along with information on holidays and promotional events. However, accurate and robust sales forecasting calls for accommodating multiple other factors, such as natural calamities, pandemics, elections, etc., impacting the demand for products and product categories in general. We propose a multi-modal sales forecasting network…
In this paper, we present SSDNet, a novel deep learning approach for time series forecasting. SSDNet combines the Transformer architecture with state space models to provide probabilistic and interpretable forecasts, including trend and seasonality components and previous time steps important for the prediction. The Transformer architecture is used to learn the temporal patterns and estimate the parameters of the state space model directly and efficiently, without the need for Kalman filters. We comprehensively evaluate the performance of SSDNet on five data sets, showing that SSDNet is an eff…
Tackling Data Heterogeneity in Federated Time Series Forecasting
The University of Queensland（昆士兰大学）；Beijing University of Posts and Telecommunications（北京邮电大学）；City University of Hong Kong（香港城市大学）；Griffith University（格里菲斯大学）；Institute of Science Tokyo（东京科学大学）
HDT: Hierarchical Discrete Transformer for Multivariate Time Series Forecasting
College of Computing and Data Science, Nanyang Technological University (NTU)（南洋理工大学计算与数据科学学院）；Webank-NTU Joint Research Institute on Fintech, NTU（微众银行-南洋理工大学金融科技联合研究院）；Tencent AI Lab（腾讯人工智能实验室）
Higher School of Economics University（高等经济大学）；Sber AI Lab（俄联邦储蓄银行人工智能实验室）；Artificial Intelligence Research Institute (AIRI)（人工智能研究院（AIRI））
The study of the stock market with the attraction of machine learning approaches is a major direction for revealing hidden market regularities. This knowledge contributes to a profound understanding of financial market dynamics and getting behavioural insights, which could hardly be discovered with traditional analytical methods. Stock prices are inherently interrelated with world events and social perception. Thus, in constructing the model for stock price prediction, the critical stage is to incorporate such information on the outside world, reflected through news and social media posts. To …
ARMA Block: A CNN-Based Autoregressive and Moving Average Module for Long-Term Time Series Forecasting
AI Lab, Grepp（Grepp人工智能实验室）；Department of Computer Science and Engineering, Hankuk University of Foreign Studies（韩国外国语大学计算机科学与工程系）；Department of Radiation Physics, The University of Texas MD Anderson Cancer Center（德克萨斯MD安德森癌症中心辐射物理系）
CATS-Linear: Classification Auxiliary Linear Model for Time Series Forecasting
School of Science, Harbin Institute of Technology, Shenzhen, China（哈尔滨工业大学（深圳）科学学院）；Harbin Institute of Technology, Shenzhen, China（哈尔滨工业大学（深圳））；University of Lille, France（里尔大学）；School of Science, Great Bay University, Dongguan, China（东莞大湾大学科学学院）
In this work, we propose a deep learning approach to forecasting state-level COVID-19 trends of weekly cumulative death in the United States (US) and incident cases in Germany. This approach includes a transformer model, an ensemble method, and a data augmentation technique for time series. We arrange the inputs of the transformer in such a way that predictions for different states can attend to the trends of the others. To overcome the issue of scarcity of training data for this COVID-19 pandemic, we have developed a novel data augmentation technique to generate useful data for training. More…
SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameters
School of Computer Science and Engineering, South China University of Technology（华南理工大学计算机科学与工程学院）；Peng Cheng Laboratory（鹏城实验室）；College of Information Science and Technology, Jinan University（暨南大学信息科学技术学院）
