A Time Series Analysis-Based Stock Price Prediction Using Machine Learning and Deep Learning Models
NSHM Knowledge Campus（NSHM知识校园）；Praxis Business School（Praxis商学院）
Sidra Mehtab, Jaydip Sen
备注：
This is the preprint of our paper accepted for publication in the Inderscience Journal International Journal of Business Forecasting and Marketing Intelligence. The paper consists of 53 pages, 26 Tables, and 46 Figures
发表信息：
International Journal of Business Forecasting and Marketing Intelligence (IJBFMI), Vol 6, No 4, pp. 272 - 335, 2020. Inderscience Publishers
Prediction of future movement of stock prices has always been a challenging task for the researchers. While the advocates of the efficient market hypothesis (EMH) believe that it is impossible to design any predictive framework that can accurately predict the movement of stock prices, there are seminal work in the literature that have clearly demonstrated that the seemingly random movement patterns in the time series of a stock price can be predicted with a high level of accuracy. Design of such predictive models requires choice of appropriate variables, right transformation methods of the variables, and tuning of the parameters of the models. In this work, we present a very robust and accurate framework of stock price prediction that consists of an agglomeration of statistical, machine learning and deep learning models. We use the daily stock price data, collected at five minutes interval of time, of a very well known company that is listed in the National Stock Exchange (NSE) of India. The granular data is aggregated into three slots in a day, and the aggregated data is used for building and training the forecasting models. We contend that the agglomerative approach of model building that uses a combination of statistical, machine learning, and deep learning approaches, can very effectively learn from the volatile and random movement patterns in a stock price data. We build eight classification and eight regression models based on statistical and machine learning approaches. In addition to these models, a deep learning regression model using a long-and-short-term memory (LSTM) network is also built. Extensive results have been presented on the performance of these models, and the results are critically analyzed.
The prediction of stock prices is an important task in economics, investment and making financial decisions. This has, for decades, spurred the interest of many researchers to make focused contributions to the design of accurate stock price predictive models; of which some have been utilized to predict the next day opening and closing prices of the stock indices. This paper proposes the design and implementation of a hybrid symbiotic organisms search trained feedforward neural network model for effective and accurate stock price prediction. The symbiotic organisms search algorithm is used as a…
Using a large-scale Deep Learning approach applied to a high-frequency database containing billions of electronic market quotes and transactions for US equities, we uncover nonparametric evidence for the existence of a universal and stationary price formation mechanism relating the dynamics of supply and demand for a stock, as revealed through the order book, to subsequent variations in its market price. We assess the model by testing its out-of-sample predictions for the direction of price moves given the history of price and order flow, across a wide range of stocks and time periods. The uni…
Henan Normal University（河南师范大学）；Yunnan Normal University（云南师范大学）；Sichuan University（四川大学）
Due to the extremely volatile nature of financial markets, it is commonly accepted that stock price prediction is a task full of challenge. However in order to make profits or understand the essence of equity market, numerous market participants or researchers try to forecast stock price using various statistical, econometric or even neural network models. In this work, we survey and compare the predictive power of five neural network models, namely, back propagation (BP) neural network, radial basis function (RBF) neural network, general regression neural network (GRNN), support vector machin…
In this paper, we show an innovative way to construct bootstrap confidence interval of a signal estimated based on a univariate LSTM model. We take three different types of bootstrap methods for dependent set up. We prescribe some useful suggestions to select the optimal block length while performing the bootstrapping of the sample. We also propose a benchmark to compare the confidence interval measured through different bootstrap strategies. We illustrate the experimental results through some stock price data set.
Stock price prediction can be made more efficient by considering the price fluctuations and understanding the sentiments of people. A limited number of models understand financial jargon or have labelled datasets concerning stock price change. To overcome this challenge, we introduced FinALBERT, an ALBERT based model trained to handle financial domain text classification tasks by labelling Stocktwits text data based on stock price change. We collected Stocktwits data for over ten years for 25 different companies, including the major five FAANG (Facebook, Amazon, Apple, Netflix, Google). These …
Rice University（莱斯大学）；Department of Economics（经济学系）
In this work we use Recurrent Neural Networks and Multilayer Perceptrons to predict NYSE, NASDAQ and AMEX stock prices from historical data. We experiment with different architectures and compare data normalization techniques. Then, we leverage those findings to question the efficient-market hypothesis through a formal statistical test.
Prediction of stock price and stock price movement patterns has always been a critical area of research. While the well-known efficient market hypothesis rules out any possibility of accurate prediction of stock prices, there are formal propositions in the literature demonstrating accurate modeling of the predictive systems that can enable us to predict stock prices with a very high level of accuracy. In this paper, we present a suite of deep learning-based regression models that yields a very high level of accuracy in stock price prediction. To build our predictive models, we use the historic…
The importance of considering the volumes to analyze stock prices movements can be considered as a well-accepted practice in the financial area. However, when we look at the scientific production in this field, we still cannot find a unified model that includes volume and price variations for stock assessment purposes. In this paper we present a computer model that could fulfill this gap, proposing a new index to evaluate stock prices based on their historical prices and volumes traded. Besides the model can be considered mathematically very simple, it was able to improve significantly the per…
Prediction of future movement of stock prices has been a subject matter of many research work. There is a gamut of literature of technical analysis of stock prices where the objective is to identify patterns in stock price movements and derive profit from it. Improving the prediction accuracy remains the single most challenge in this area of research. We propose a hybrid approach for stock price movement prediction using machine learning, deep learning, and natural language processing. We select the NIFTY 50 index values of the National Stock Exchange of India, and collect its daily price move…
University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；Department of Electrical & Computer Engineering（电气与计算机工程系）
In this work, we apply machine learning techniques to historical stock prices to forecast future prices. To achieve this, we use recursive approaches that are appropriate for handling time series data. In particular, we apply a linear Kalman filter and different varieties of long short-term memory (LSTM) architectures to historical stock prices over a 10-year range (1/1/2011 - 1/1/2021). We quantify the results of these models by computing the error of the predicted values versus the historical values of each stock. We find that of the algorithms we investigated, a simple linear Kalman filter …
Praxis Business School（实践商学院）；NSHM Knowledge Campus（NSHM知识园区）
Building predictive models for robust and accurate prediction of stock prices and stock price movement is a challenging research problem to solve. The well-known efficient market hypothesis believes in the impossibility of accurate prediction of future stock prices in an efficient stock market as the stock prices are assumed to be purely stochastic. However, numerous works proposed by researchers have demonstrated that it is possible to predict future stock prices with a high level of precision using sophisticated algorithms, model architectures, and the selection of appropriate variables in t…
News-Driven Stock Price Forecasting in Indian Markets: A Comparative Study of Advanced Deep Learning Models
Pegasystems India Worldwide Pvt Ltd（佩加系统印度私人有限公司）；Vardhaman College of Engineering（瓦尔达曼工程学院）；Vasavi College of Engineering（瓦萨维工程学院）；D. K. College（D.K.学院）
The stock market is volatile and complicated, especially in 2020. Because of a series of global and regional "black swans," such as the COVID-19 pandemic, the U.S. stock market triggered the circuit breaker three times within one week of March 9 to 16, which is unprecedented throughout history. Affected by the whole circumstance, the stock prices of individual corporations also plummeted by rates that were never predicted by any pre-developed forecasting models. It reveals that there was a lack of satisfactory models that could predict the changes in stocks prices when catastrophic, highly unl…
SRM Institute of Science and Technology（SRM科学技术研究所）
Economy is severely dependent on the stock market. An uptrend usually corresponds to prosperity while a downtrend correlates to recession. Predicting the stock market has thus been a centre of research and experiment for a long time. Being able to predict short term movements in the market enables investors to reap greater returns on their investments. Stock prices are extremely volatile and sensitive to financial market. In this paper we use Deep Learning networks to predict stock prices, assimilating financial, business and technology news articles which present information about the market.…
This paper tends to define the quantitative relationship between the stock price and time as a time function. Based on the empirical evidence that the log-return of a stock is the series of white noise, a mathematical model of the integral white noise is established to describe the phenomenon of stock price movement. A deductive approach is used to derive the auto-correlation function, displacement formula and power spectral density of the stock price movement, which reveals not only the characteristics and rules of the movement but also the predictability of the stock price. The deductive fun…
This paper examines the short-run relationships between oil prices and GCC stock markets. Since GCC countries are major world energy market players, their stock markets may be susceptible to oil price shocks. To account for the fact that stock markets may respond nonlinearly to oil price shocks, we have examined both linear and nonlinear relationships. Our findings show that there are significant links between the two variables in Qatar, Oman, and UAE. Thus, stock markets in these countries react positively to oil price increases. For Bahrain, Kuwait, and Saudi Arabia we found that oil price c…
School of Industrial Management Engineering, Korea University（高丽大学产业管理工程学院）；Harbin Institute of Technology（哈尔滨工业大学）
The prediction of a stock market direction may serve as an early recommendation system for short-term investors and as an early financial distress warning system for long-term shareholders. Many stock prediction studies focus on using macroeconomic indicators, such as CPI and GDP, to train the prediction model. However, daily data of the macroeconomic indicators are almost impossible to obtain. Thus, those methods are difficult to be employed in practice. In this paper, we propose a method that directly uses prices data to predict market index direction and stock price direction. An extensive …
Neural networks for stock price prediction(NNSPP) have been popular for decades. However, most of its study results remain in the research paper and cannot truly play a role in the securities market. One of the main reasons leading to this situation is that the prediction error(PE) based evaluation results have statistical flaws. Its prediction results cannot represent the most critical financial direction attributes. So it cannot provide investors with convincing, interpretable, and consistent model performance evaluation results for practical applications in the securities market. To illustr…
School of Computing and Informatics, University of Nairobi（内罗毕大学计算与信息学院）
Predicting the prices of stocks at any stock market remains a quest for many investors and researchers. Those who trade at the stock market tend to use technical, fundamental or time series analysis in their predictions. These methods usually guide on trends and not the exact likely prices. It is for this reason that Artificial Intelligence systems, such as Artificial Neural Network, that is feedforward multi-layer perceptron with error backpropagation, can be used for such predictions. A difficulty in neural network application is the determination of suitable network parameters. A previous r…
Stock market prediction has been an active area of research for a considerable period. Arrival of computing, followed by Machine Learning has upgraded the speed of research as well as opened new avenues. As part of this research study, we aimed to predict the future stock movement of shares using the historical prices aided with availability of sentiment data. Two models were used as part of the exercise, LSTM was the first model with historical prices as the independent variable. Sentiment Analysis captured using Intensity Analyzer was used as the major parameter for Random Forest Model used …
We propose procedures for testing whether stock price processes are martingales based on limit order type betting strategies. We first show that the null hypothesis of martingale property of a stock price process can be tested based on the capital process of a betting strategy. In particular with high frequency Markov type strategies we find that martingale null hypotheses are rejected for many stock price processes.
COVID-19 is an infectious disease that mostly affects the respiratory system. At the time of this research being performed, there were more than 1.4 million cases of COVID-19, and one of the biggest anxieties is not just our health, but our livelihoods, too. In this research, authors investigate the impact of COVID-19 on the global economy, more specifically, the impact of COVID-19 on financial movement of Crude Oil price and three U.S. stock indexes: DJI, S&P 500 and NASDAQ Composite. The proposed system for predicting commodity and stock prices integrates the Stationary Wavelet Transform (SW…
While the use of volatilities is pervasive throughout finance, our ability to determine the instantaneous volatility of stocks is nascent. Here, we present a method for measuring the temporal behavior of stocks, and show that stock prices for 24 DJIA stocks follow a stochastic process that describes an efficiently priced stock while using a volatility that changes deterministically with time. We find that the often observed, abnormally large kurtoses are due to temporal variations in the volatility. Our method can resolve changes in volatility and drift of the stocks as fast as a single day us…
Recent academic work has developed a method to determine, in real time, if a given stock is exhibiting a price bubble. Currently there is speculation in the financial press concerning the existence of a price bubble in the aftermath of the recent IPO of LinkedIn. We analyze stock price tick data from the short lifetime of this stock through May 24, 2011, and we find that LinkedIn has a price bubble.
We revisit the problem of predicting directional movements of stock prices based on news articles: here our algorithm uses daily articles from The Wall Street Journal to predict the closing stock prices on the same day. We propose a unified latent space model to characterize the "co-movements" between stock prices and news articles. Unlike many existing approaches, our new model is able to simultaneously leverage the correlations: (a) among stock prices, (b) among news articles, and (c) between stock prices and news articles. Thus, our model is able to make daily predictions on more than 500 s…
Stock exchanges are considered major players in financial sectors of many countries. Most Stockbrokers, who execute stock trade, use technical, fundamental or time series analysis in trying to predict stock prices, so as to advise clients. However, these strategies do not usually guarantee good returns because they guide on trends and not the most likely price. It is therefore necessary to explore improved methods of prediction. The research proposes the use of Artificial Neural Network that is feedforward multi-layer perceptron with error backpropagation and develops a model of configuration …
This paper analyzes the quantitative relations between stock prices and quantities of tradable stock shares in Chinese stock markets at six time points by means of Exploratory Data Analysis (EDA) method. It is found the resulting formulae have the same structure but different parameters. This paper also uses these relationships in order to analyse the feasibility of policies for Chinese Government to sell the state-owned shares in Chinese stock markets.
Stock prices are driven by various factors. In particular, many individual investors who have relatively little financial knowledge rely heavily on the information from news stories when making investment decisions in the stock market. However, these stories may not reflect future stock prices because of the subjectivity in the news; stock prices may instead affect the news contents. This study aims to discover whether it is news or stock prices that have a greater impact on the other. To achieve this, we analyze the relationship between news sentiment and stock prices based on time series ana…
We analyze daily prices of 29 commodities and 2449 stocks, each over a period of $\approx 15$ years. We find that the price fluctuations for commodities have a significantly broader multifractal spectrum than for stocks. We also propose that multifractal properties of both stocks and commodities can be attributed mainly to the broad probability distribution of price fluctuations and secondarily to their temporal organization. Furthermore, we propose that, for commodities, stronger higher order correlations in price fluctuations result in broader multifractal spectra.
We analyze the interaction between stock prices of big companies in the USA and Germany using Granger Causality. We claim that the increase in pair-wise Granger causality interaction between prices in the times of crisis is the consequence of simultaneous response of the markets to the outside events or external stimulus that is considered as a common driver to all the stocks, not a result of real causal predictability between the prices themselves. An alternative approach through recurrence analysis in single stock price series supports this claim. The observed patterns in the price of stocks…
Boosting Stock Price Prediction with Anticipated Macro Policy Changes
Institute of Electrical and Electronics Engineers（电气与电子工程师协会）；University of Tennessee, Chattanooga（田纳西大学查塔努加分校）；University of South Dakota（南达科他大学）；University of Tennessee, Knoxville（田纳西大学诺克斯维尔分校）
This paper investigates the effect of cross-shareholding on stock price synchronicity, as a measure of price informativeness, of the listed firms in the Chinese stock market. We gauge firms' levels of cross-shareholdings in terms of centrality in the cross-shareholding network. It is confirmed that it is through a noise-reducing process that cross-shareholding promotes price synchronicity and reduces price delay. More importantly, this effect on price informativeness is pronounced for large firms and in the periods of market downturns. Overall, our analyses provide insights into the relation b…
Price limit trading rules are adopted in some stock markets (especially emerging markets) trying to cool off traders' short-term trading mania on individual stocks and increase market efficiency. Under such a microstructure, stocks may hit their up-limits and down-limits from time to time. However, the behaviors of price limit hits are not well studied partially due to the fact that main stock markets such as the US markets and most European markets do not set price limits. Here, we perform detailed analyses of the high-frequency data of all A-share common stocks traded on the Shanghai Stock E…
Earnings calls are hosted by management of public companies to discuss the company's financial performance with analysts and investors. Information disclosed during an earnings call is an essential source of data for analysts and investors to make investment decisions. Thus, we leverage earnings call transcripts to predict future stock price dynamics. We propose to model the language in transcripts using a deep learning framework, where an attention mechanism is applied to encode the text data into vectors for the discriminative network classifier to predict stock price movements. Our empirica…
Generalized Stock Price Prediction for Multiple Stocks Combined with News Fusion
Graduate Institute of Electrical Engineering, National Taiwan University（国立台湾大学电子工程研究所）；Institute of Information Science, Academia Sinica（学术院信息科学研究所）；United Link Co., Ltd.（联合链接公司）；University of Washington（华盛顿大学）；National Tsing Hua University（国立清华大学）
This paper presents a novel approach to predicting stock prices using technical analysis. By utilizing Ito's lemma and Euler-Maruyama methods, the researchers develop Heston and Geometric Brownian Motion models that take into account volatility, interest rate, and historical stock prices to generate predictions. The results of the study demonstrate that these models are effective in accurately predicting stock prices and outperform commonly used statistical indicators. The authors conclude that this technical analysis-based method offers a promising solution for stock market prediction.
Designing robust frameworks for precise prediction of future prices of stocks has always been considered a very challenging research problem. The advocates of the classical efficient market hypothesis affirm that it is impossible to accurately predict the future prices in an efficiently operating market due to the stochastic nature of the stock price variables. However, numerous propositions exist in the literature with varying degrees of sophistication and complexity that illustrate how algorithms and models can be designed for making efficient, accurate, and robust predictions of stock price…
We study the rank distribution, the cumulative probability, and the probability density of returns of stock prices of listed firms traded in four stock markets. We find that the rank distribution and the cumulative probability of stock prices traded in are consistent approximately with the Zipf's law or a power law. It is also obtained that the probability density of normalized returns for listed stocks almost has the form of the exponential function. Our results are compared with those of other numerical calculations.
Many studies assume stock prices follow a random process known as geometric Brownian motion. Although approximately correct, this model fails to explain the frequent occurrence of extreme price movements, such as stock market crashes. Using a large collection of data from three different stock markets, we present evidence that a modification to the random model -- adding a slow, but significant, fluctuation to the standard deviation of the process -- accurately explains the probability of different-sized price changes, including the relative high frequency of extreme movements. Furthermore, we…
Methods for Acquiring and Incorporating Knowledge into Stock Price Prediction: A Survey
The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；Shanghai Jiao Tong University（上海交通大学）；The Chinese University of Hong Kong（香港中文大学）
Stock market forecasting is a classic problem that has been thoroughly investigated using machine learning and artificial neural network based tools and techniques. Interesting aspects of this problem include its time reliance as well as its volatility and other complex relationships. To combine them, hidden markov models (HMMs) have been utilized to anticipate the price of stocks. We demonstrated the Maximum A Posteriori (MAP) HMM method for predicting stock prices for the next day based on previous data. An HMM is trained by analyzing the fractional change in the stock price as well as the i…
We introduce a non linear pricing model of individual stock returns that defines a stickiness parameter of the returns. The pricing model resembles the capital asset pricing model used in finance but has a non linear component inspired from models of earth quake tectonic plate movements. The link to tectonic plate movements happens, since price movements of a given stock index is seen adding stress to its components of individual stock returns, in order to follow the index. How closely individual stocks follow the indexs price movements, can then be used to define their stickiness
Volatility dynamics of wavelet - filtered stock price time series is studied. Using the universal thresholding method of wavelet filtering and a principle of minimal linear autocorrelation of noise component we find that the quantitative characteristics of volatility dynamics of denoised series are noticeably different from those of the raw data and the noise.
In this paper we quantitatively investigate the statistical properties of an ensemble of {\it stock prices}. We selected 1200 stocks traded in the Tokyo Stock Exchange and formed a statistical ensemble of daily stock prices for each trading day in the 5 year period from January 4, 1988 to December 30, 1992. We found that the tail of the complementary cumulative distribution function of the ensembles is accurately described by a power-law distribution with an exponent that moves in the range of $ 1.7 < α< 2.2 $.
Price gap, defined as the logarithmic price difference between the first two occupied price levels on the same side of a limit order book (LOB), is a key determinant of market depth, which is one of the dimensions of liquidity. However, the properties of price gaps have not been thoroughly studied due to the less availability of ultrahigh frequency data. In the paper, we rebuild the LOB dynamics based on the order flow data of 26 A-share stocks traded on the Shenzhen Stock Exchange in 2003. Three key empirical statistical properties of price gaps are investigated. We find that the distribution…
We study the statistics of record-breaking events in daily stock prices of 366 stocks from the Standard and Poors 500 stock index. Both the record events in the daily stock prices themselves and the records in the daily returns are discussed. In both cases we try to describe the record statistics of the stock data with simple theoretical models. The daily returns are compared to i.i.d. RV's and the stock prices are modeled using a biased random walk, for which the record statistics are known. These models agree partly with the behavior of the stock data, but we also identify several interestin…
