This paper applies a recurrent neural network (RNN) method to forecast cotton and oil prices. We show how these new tools from machine learning, particularly Long-Short Term Memory (LSTM) models, complement traditional methods. Our results show that machine learning methods fit reasonably well the data but do not outperform systematically classical methods such as Autoregressive Integrated Moving Average (ARIMA) models in terms of out of sample forecasts. However, averaging the forecasts from the two type of models provide better results compared to either method. Compared to the ARIMA and the LSTM, the Root Mean Squared Error (RMSE) of the average forecast was 0.21 and 21.49 percent lower respectively for cotton. For oil, the forecast averaging does not provide improvements in terms of RMSE. We suggest using a forecast averaging method and extending our analysis to a wide range of commodity prices.
Institute of High Commercial Studies of Sousse (IHEC)（苏塞高等商业学院（IHEC））
Accurate electricity price forecasting is the main management goal for market participants since it represents the fundamental basis to maximize the profits for market players. However, electricity is a non-storable commodity and the electricity prices are affected by some social and natural factors that make the price forecasting a challenging task. This study investigates the predictive performance of a new hybrid model based on the Generalized long memory autoregressive model (k-factor GARMA), the Gegenbauer Generalized Autoregressive Conditional Heteroscedasticity(G-GARCH) process, Wavelet…
News-Driven Stock Price Forecasting in Indian Markets: A Comparative Study of Advanced Deep Learning Models
Pegasystems India Worldwide Pvt Ltd（佩加系统印度私人有限公司）；Vardhaman College of Engineering（瓦尔达曼工程学院）；Vasavi College of Engineering（瓦萨维工程学院）；D. K. College（D.K.学院）
Pacific Northwest National Laboratory（太平洋西北国家实验室）；University of Notre Dame（圣母大学）
Social media signals have been successfully used to develop large-scale predictive and anticipatory analytics. For example, forecasting stock market prices and influenza outbreaks. Recently, social data has been explored to forecast price fluctuations of cryptocurrencies, which are a novel disruptive technology with significant political and economic implications. In this paper we leverage and contrast the predictive power of social signals, specifically user behavior and communication patterns, from multiple social platforms GitHub and Reddit to forecast prices for three cyptocurrencies with …
Wrocław University of Science and Technology（弗罗茨瓦夫科技大学）；Delft University of Technology（代尔夫特理工大学）；Energyville（能源城）；Flemish Institute for Technological Research (VITO)（弗拉芒技术研究院）
Recent advancements in the fields of artificial intelligence and machine learning methods resulted in a significant increase of their popularity in the literature, including electricity price forecasting. Said methods cover a very broad spectrum, from decision trees, through random forests to various artificial neural network models and hybrid approaches. In electricity price forecasting, neural networks are the most popular machine learning method as they provide a non-linear counterpart for well-tested linear regression models. Their application, however, is not straightforward, with multipl…
Highly accurate interval forecasting of a stock price index is fundamental to successfully making a profit when making investment decisions, by providing a range of values rather than a point estimate. In this study, we investigate the possibility of forecasting an interval-valued stock price index series over short and long horizons using multi-output support vector regression (MSVR). Furthermore, this study proposes a firefly algorithm (FA)-based approach, built on the established MSVR, for determining the parameters of MSVR (abbreviated as FA-MSVR). Three globally traded broad market indice…
University of Oxford（牛津大学）；Saïd Business School（赛德商学院）
This research paper explores the performance of Machine Learning (ML) algorithms and techniques that can be used for financial asset price forecasting. The prediction and forecasting of asset prices and returns remains one of the most challenging and exciting problems for quantitative finance and practitioners alike. The massive increase in data generated and captured in recent years presents an opportunity to leverage Machine Learning algorithms. This study directly compares and contrasts state-of-the-art implementations of modern Machine Learning algorithms on high performance computing (HPC…
An accurate prediction of crude oil prices over long future horizons is challenging and of great interest to governments, enterprises, and investors. This paper proposes a revised hybrid model built upon empirical mode decomposition (EMD) based on the feed-forward neural network (FNN) modeling framework incorporating the slope-based method (SBM), which is capable of capturing the complex dynamic of crude oil prices. Three commonly used multi-step-ahead prediction strategies proposed in the literature, including iterated strategy, direct strategy, and MIMO (multiple-input multiple-output) strat…
GEIRI North America（北美全球能源互联网研究院）；University of Minnesota Twin Cities（明尼苏达大学双城分校）
A study on power market price forecasting by deep learning is presented. As one of the most successful deep learning frameworks, the LSTM (Long short-term memory) neural network is utilized. The hourly prices data from the New England and PJM day-ahead markets are used in this study. First, a LSTM network is formulated and trained. Then the raw input and output data are preprocessed by unit scaling, and the trained network is tested on the real price data under different input lengths, forecasting horizons and data sizes. Its performance is also compared with other existing methods. The foreca…
Electricity price is a key factor affecting the decision-making for all market participants. Accurate forecasting of electricity prices is very important and is also very challenging since electricity price is highly volatile due to various factors. This paper proposes an integrated long-term recurrent convolutional network (ILRCN) model to predict electricity prices considering the majority contributing attributes to the market price as input. The proposed ILRCN model combines the functionalities of convolutional neural network and long short-term memory (LSTM) algorithm along with the propos…
Bayesian Neural Networks with Monte Carlo Dropout for Probabilistic Electricity Price Forecasting
Faculty of Mathematics and Economics（数学与经济学学院）；Ulm University（乌尔姆大学）；Department of Mathematics, Natural and Economic Sciences（数学、自然科学与经济科学系）；Ulm University of Applied Sciences（乌尔姆应用科学大学）
Energy Price Modelling: A Comparative Evaluation of four Generations of Forecasting Methods
Bucharest University of Economic Studies（布加勒斯特经济研究大学）；Humboldt University of Berlin（柏林洪堡大学）；California Institute of Technology（加州理工学院）；Institute for Economic Forecasting, Romanian Academy（罗马尼亚科学院经济预测研究所）
A Market-Rule-Informed Neural Network for Efficient Imbalance Electricity Price Forecasting
Delft University of Technology（代尔夫特理工大学）；Austrian Institute of Technology（奥地利技术研究院）；London Business School（伦敦商学院）；University of Technology Sydney（悉尼大学）；The Chinese University of Hongkong (Shenzhen)（香港中文大学（深圳））
Oregon State University（俄勒冈州立大学）；University of Texas at Arlington（德克萨斯大学阿灵顿分校）
Crude oil is a major component in most advanced economies of the world. Accurately predicting and understanding the behavior of crude oil prices is important for economists, analysts, forecasters, and traders, to name a few. The price of crude oil has declined in the past decade and is seeing a phase of stability; but will this stability last? This work is an empirical study on how multivariate analysis may be employed to predict crude oil spot prices using neural networks. The concept of using neural networks showed promising potential. A very simple neural network model was able to perform o…
National Central University（国立中央大学）；National Pingtung University（国立屏东大学）；Jiangxi University of Science and Technology（江西理工大学）
In the modern power market, electricity trading is an extremely competitive industry. More accurate price forecast is crucial to help electricity producers and traders make better decisions. In this paper, a novel method of convolutional neural network (CNN) is proposed to rapidly provide hourly forecasting in the energy market. To improve prediction accuracy, we divide the annual electricity price data into four categories by seasons and conduct training and forecasting for each category respectively. By comparing the proposed method with other existing methods, we find that the proposed mode…
Recent studies concerning the point electricity price forecasting have shown evidence that the hourly German Intraday Continuous Market is weak-form efficient. Therefore, we take a novel, advanced approach to the problem. A probabilistic forecasting of the hourly intraday electricity prices is performed by simulating trajectories in every trading window to receive a realistic ensemble to allow for more efficient intraday trading and redispatch. A generalized additive model is fitted to the price differences with the assumption that they follow a zero-inflated distribution, precisely a mixture …
National University of Sciences and Technology（国立科技大学）；Information Technology University (ITU)（信息技术大学（ITU））
Wheat is the main agricultural crop of Pakistan and is a staple food requirement of almost every Pakistani household making it the main strategic commodity of the country whose availability and affordability is the government's main priority. Wheat food availability can be vastly affected by multiple factors included but not limited to the production, consumption, financial crisis, inflation, or volatile market. The government ensures food security by particular policy and monitory arrangements, which keeps up purchase parity for the poor. Such arrangements can be made more effective if a dyna…
Shanghai University of Finance and Economics（上海财经大学）
Research on crude oil price forecasting has attracted tremendous attention from scholars and policymakers due to its significant effect on the global economy. Besides supply and demand, crude oil prices are largely influenced by various factors, such as economic development, financial markets, conflicts, wars, and political events. Most previous research treats crude oil price forecasting as a time series or econometric variable prediction problem. Although recently there have been researches considering the effects of real-time news events, most of these works mainly use raw news headlines or…
Budapest University of Technology and Economics（布达佩斯技术与经济大学）
Energy price forecasting is a relevant yet hard task in the field of multi-step time series forecasting. In this paper we compare a well-known and established method, ARMA with exogenous variables with a relatively new technique Gradient Boosting Regression. The method was tested on data from Global Energy Forecasting Competition 2014 with a year long rolling window forecast. The results from the experiment reveal that a multi-model approach is significantly better performing in terms of error metrics. Gradient Boosting can deal with seasonality and auto-correlation out-of-the box and achieve …
Intra-day price spreads are of interest to electricity traders, storage and electric vehicle operators. This paper formulates dynamic density functions, based upon skewed-t and similar representations, to model and forecast the German electricity price spreads between different hours of the day, as revealed in the day-ahead auctions. The four specifications of the density functions are dynamic and conditional upon exogenous drivers, thereby permitting the location, scale and shape parameters of the densities to respond hourly to such factors as weather and demand forecasts. The best fitting an…
Probabilistic intraday electricity price forecasting using generative machine learning
Institute of Statistics, Karlsruhe Institute of Technology（卡尔斯鲁厄技术大学统计研究所）；Heidelberg Institute for Theoretical Studies（海德堡理论研究所）；Department of Mathematics and Computer Science, Marburg University（马堡大学数学与计算机科学系）；Department of Operations Research and Business Intelligence, Wrocław University of Science and Technology（波兹南大学 of Science and Technology 运筹学与商业智能系）
Time series forecasting is essential for decision making in many domains. In this work, we address the challenge of predicting prices evolution among multiple potentially interacting financial assets. A solution to this problem has obvious importance for governments, banks, and investors. Statistical methods such as Auto Regressive Integrated Moving Average (ARIMA) are widely applied to these problems. In this paper, we propose to approach economic time series forecasting of multiple financial assets in a novel way via video prediction. Given past prices of multiple potentially interacting fin…
Stock price prediction is a rich research topic that has attracted interest from various areas of science. The recent success of machine learning in speech and image recognition has prompted researchers to apply these methods to asset price prediction. The majority of literature has been devoted to predicting either the actual asset price or the direction of price movement. In this paper, we study a hitherto little explored question of predicting significant changes in stock price based on previous changes using machine learning algorithms. We are particularly interested in the performance of …
Aristotle University of Thessaloniki（塞萨洛尼基亚里士多德大学）；Tampere University of Technology（坦佩雷理工大学）；Aarhus University（奥胡斯大学）
Forecasting the movements of stock prices is one the most challenging problems in financial markets analysis. In this paper, we use Machine Learning (ML) algorithms for the prediction of future price movements using limit order book data. Two different sets of features are combined and evaluated: handcrafted features based on the raw order book data and features extracted by ML algorithms, resulting in feature vectors with highly variant dimensionalities. Three classifiers are evaluated using combinations of these sets of features on two different evaluation setups and three prediction scenari…
OrderFusion: Encoding Orderbook for End-to-End Probabilistic Intraday Electricity Price Forecasting
Delft University of Technology（代尔夫特理工大学）；Austrian Institute of Technology（奥地利技术研究院）；RWTH Aachen（亚琛工业大学）；London Business School（伦敦商学院）；University of Oxford（牛津大学）；Squirrel AI（Squirrel AI公司）；Tsinghua University（清华大学）
We test whether the futures prices of some commodity and energy markets are determined by stochastic rules or exhibit nonlinear deterministic endogenous fluctuations. As for the methodologies, we use the maximal Lyapunov exponents (MLE) and a determinism test, both based on the reconstruction of the phase space. In particular, employing a recent methodology, we estimate a coefficient $κ$ that describes the determinism rate of the analyzed time series. We find that the underlying system for futures prices shows a reliability level $κ$ near to $1$ while the MLE is positive for all commodity futu…
Price fluctuations of commodities like cotton and wheat are thought to display probability distributions of returns that follow a Lévy stable distribution. Recent analysis of stocks and foreign exchange markets show that the probability distributions are not Lévy stable, a plausible result since commodity markets have quite different features than stock markets. We analyze daily returns of 29 commodities over typically 20 years and find that the distributions of returns decay as power laws with exponents $α$ which have values $α> 2$, outside the Lévy-stable domain. We also find that the amplit…
University of Verona（维罗纳大学）；Bergische Universität Wuppertal（伍珀塔尔贝格大学）；Technische Universität Darmstadt（达姆施塔特工业大学）
In this work we considered several hybrid modelling approaches for forecasting energy spot prices in EPEC market. Hybridization is performed through combining a Naive model, Fourier analysis, ARMA and GARCH models, a mean-reversion and jump-diffusion model, and Recurrent Neural Networks (RNN). Training data was given in terms of electricity prices for 2013-2014 years, and test data as a year of 2015.
School of Management, Xi'an Jiaotong University（西安交通大学管理学院）
Faced with the growing research towards crude oil price fluctuations influential factors following the accelerated development of Internet technology, accessible data such as Google search volume index are increasingly quantified and incorporated into forecasting approaches. In this paper, we apply multi-scale data that including both GSVI data and traditional economic data related to crude oil price as independent variables and propose a new hybrid approach for monthly crude oil price forecasting. This hybrid approach, based on divide and conquer strategy, consists of K-means method, kernel p…
Rice University（莱斯大学）；Department of Economics（经济学系）
In this work we use Recurrent Neural Networks and Multilayer Perceptrons to predict NYSE, NASDAQ and AMEX stock prices from historical data. We experiment with different architectures and compare data normalization techniques. Then, we leverage those findings to question the efficient-market hypothesis through a formal statistical test.
Forecasting imbalance prices is essential for strategic participation in the short-term energy markets. A novel two-step probabilistic approach is proposed, with a particular focus on the Belgian case. The first step consists of computing the net regulation volume state transition probabilities. It is modeled as a matrix computed using historical data. This matrix is then used to infer the imbalance prices since the net regulation volume can be related to the level of reserves activated and the corresponding marginal prices for each activation level are published by the Belgian Transmission Sy…
This paper studies how to forecast daily closing price series of Bitcoin, using data on prices and volumes of prior days. Bitcoin price behaviour is still largely unexplored, presenting new opportunities. We compared our results with two modern works on Bitcoin prices forecasting and with a well-known recent paper that uses Intel, National Bank shares and Microsoft daily NASDAQ closing prices spanning a 3-year interval. We followed different approaches in parallel, implementing both statistical techniques and machine learning algorithms. The SLR model for univariate series forecast uses only c…
This article continues our analysis of the gold price dynamics that was published in December 2010 (abs/1012.4118) and forecasted the possibility of the "burst of the gold bubble" in April - June 2011. Our recent analysis suggests the possibility of one more substantial fluctuation before the final collapse in July 2011. On the other hand, in early 2011 we detected a number of other commodity bubbles and forecasted the start of their collapse in May - June 2011. We demonstrate that this collapse has actually begun, which in conjunction with the forthcoming burst of the gold bubble suggests tha…
In this paper we present a regression based model for day-ahead electricity spot prices. We estimate the considered linear regression model by the lasso estimation method. The lasso approach allows for many possible parameters in the model, but also shrinks and sparsifies the parameters automatically to avoid overfitting. Thus, it is able to capture the autoregressive intraday dependency structure of the electricity price well. We discuss in detail the estimation results which provide insights to the intraday behavior of electricity prices. We perform an out-of-sample forecasting study for sev…
With the heightened volatility in stock prices during the Covid-19 pandemic, the need for price forecasting has become more critical. We investigated the forecast performance of four models including Long-Short Term Memory, XGBoost, Autoregression, and Last Value on stock prices of Facebook, Amazon, Tesla, Google, and Apple in COVID-19 pandemic time to understand the accuracy and predictability of the models in this highly volatile time region. To train the models, the data of all stocks are split into train and test datasets. The test dataset starts from January 2020 to April 2021 which cover…
In this paper, we propose and study a novel continuous-time model, based on the well-known constant elasticity of variance (CEV) model, to describe the asset price process. The basic idea is that the volatility elasticity of the CEV model can not be treated as a constant from the perspective of stochastic analysis. To address this issue, we deduce the price process of assets from the perspective of volatility elasticity, propose the constant volatility elasticity (CVE) model, and further derive a more general variable volatility elasticity (VVE) model. Moreover, our model can describe the posi…
