Standard methods and theories in finance can be ill-equipped to capture highly non-linear interactions in financial prediction problems based on large-scale datasets, with deep learning offering a way to gain insights into correlations in markets as complex systems. In this paper, we apply deep learning to econometrically constructed gradients to learn and exploit lagged correlations among S&P 500 stocks to compare model behaviour in stable and volatile market environments, and under the exclusion of target stock information for predictions. In order to measure the effect of time horizons, we predict intraday and daily stock price movements in varying interval lengths and gauge the complexity of the problem at hand with a modification of our model architecture. Our findings show that accuracies, while remaining significant and demonstrating the exploitability of lagged correlations in stock markets, decrease with shorter prediction horizons. We discuss implications for modern finance theory and our work's applicability as an investigative tool for portfolio managers. Lastly, we show that our model's performance is consistent in volatile markets by exposing it to the environment of the recent financial crisis of 2007/2008.
We propose the application of a high-speed maximum likelihood clustering algorithm to detect temporal financial market states, using correlation matrices estimated from intraday market microstructure features. We first determine the ex-ante intraday temporal cluster configurations to identify market states, and then study the identified temporal state features to extract state signature vectors which enable online state detection. The state signature vectors serve as low-dimensional state descriptors which can be used in learning algorithms for optimal planning in the high-frequency trading do…
We formulate an equilibrium model of intraday trading in electricity markets. Agents face balancing constraints between their customers consumption plus intraday sales and their production plus intraday purchases. They have continuously updated forecast of their customers consumption at maturity with decreasing volatility error. Forecasts are prone to idiosyncratic noise as well as common noise (weather). Agents production capacities are subject to independent random outages, which are each modelled by a Markov chain. The equilibrium price is defined as the price that minimises trading cost pl…
From Intraday Orderbook to Imbalance Price: Understanding Cross-Market Interaction
London Business School（伦敦商学院）；Delft University of Technology（代尔夫特理工大学）；Austrian Institute of Technology（奥地利技术研究所）；Imperial College London（帝国理工学院）；Technical University of Denmark（丹麦技术大学）；Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；Institute of Science Tokyo（东京科学大学）
OrderFusion: Encoding Orderbook for End-to-End Probabilistic Intraday Electricity Price Forecasting
Delft University of Technology（代尔夫特理工大学）；Austrian Institute of Technology（奥地利技术研究院）；RWTH Aachen（亚琛工业大学）；London Business School（伦敦商学院）；University of Oxford（牛津大学）；Squirrel AI（Squirrel AI公司）；Tsinghua University（清华大学）
We apply machine learning models to forecast intraday realized volatility (RV), by exploiting commonality in intraday volatility via pooling stock data together, and by incorporating a proxy for the market volatility. Neural networks dominate linear regressions and tree-based models in terms of performance, due to their ability to uncover and model complex latent interactions among variables. Our findings remain robust when we apply trained models to new stocks that have not been included in the training set, thus providing new empirical evidence for a universal volatility mechanism among stoc…
We extend prior evidence that naively using intraday agent-based models that involve realistic order-matching processes for modeling continuous-time double auction markets seems to fail to be able to provide a robust link between data and many model parameters, even when these models are able to reproduce a number of well-known stylized facts of return time series. We demonstrate that while the parameters of intraday agent-based models rooted in market microstructure can be meaningfully calibrated, those exclusively related to agent behaviors and incentives remain problematic. This could simpl…
The increasing richness in volume, and especially types of data in the financial domain provides unprecedented opportunities to understand the stock market more comprehensively and makes the price prediction more accurate than before. However, they also bring challenges to classic statistic approaches since those models might be constrained to a certain type of data. Aiming at aggregating differently sourced information and offering type-free capability to existing models, a framework for predicting stock market of scenarios with mixed data, including scalar data, compositional data (pie-like)…
The validity of the Efficient Market Hypothesis has been under severe scrutiny since several decades. However, the evidence against it is not conclusive. Artificial Neural Networks provide a model-free means to analize the prediction power of past returns on current returns. This chapter analizes the predictability in the intraday Brazilian stock market using a backpropagation Artificial Neural Network. We selected 20 stocks from Bovespa index, according to different market capitalization, as a proxy for stock size. We find that predictability is related to capitalization. In particular, large…
We implement a master-slave parallel genetic algorithm (PGA) with a bespoke log-likelihood fitness function to identify emergent clusters within price evolutions. We use graphics processing units (GPUs) to implement a PGA and visualise the results using disjoint minimal spanning trees (MSTs). We demonstrate that our GPU PGA, implemented on a commercially available general purpose GPU, is able to recover stock clusters in sub-second speed, based on a subset of stocks in the South African market. This represents a pragmatic choice for low-cost, scalable parallel computing and is significantly fa…
