In recent years, a wide range of investment models have been created using artificial intelligence. Automatic trading by artificial intelligence can expand the range of trading methods, such as by conferring the ability to operate 24 hours a day and the ability to trade with high frequency. Automatic trading can also be expected to trade with more information than is available to humans if it can sufficiently consider past data. In this paper, we propose an investment agent based on a deep reinforcement learning model, which is an artificial intelligence model. The model considers the transaction costs involved in actual trading and creates a framework for trading over a long period of time so that it can make a large profit on a single trade. In doing so, it can maximize the profit while keeping transaction costs low. In addition, in consideration of actual operations, we use online learning so that the system can continue to learn by constantly updating the latest online data instead of learning with static data. This makes it possible to trade in non-stationary financial markets by always incorporating current market trend information.
We consider learning a trading agent acting on behalf of the treasury of a firm earning revenue in a foreign currency (FC) and incurring expenses in the home currency (HC). The goal of the agent is to maximize the expected HC at the end of the trading episode by deciding to hold or sell the FC at each time step in the trading episode. We pose this as an optimization problem, and consider a broad spectrum of approaches with the learning component ranging from supervised to imitation to reinforcement learning. We observe that most of the approaches considered struggle to improve upon simple heur…
Our previous research has confirmed that the USD/JPY rate tends to rise toward 9:55 every morning in the Gotobi days, which are divisible by five. This is called the Gotobi anomaly. In the present study, we verify the possible trading strategy and its validity under the condition that investors recognize the existence of the anomaly. Moreover, we illustrate the possibility that the wealth of Japanese companies might leak to FX traders due to the arbitrage opportunity if Japanese companies blindly keep making payments in the Gotobi days as a business custom.
Northeast Electric Power University（东北电力大学）；Hanyang University（汉阳大学）
The emerging cryptocurrency market has lately received great attention for asset allocation due to its decentralization uniqueness. However, its volatility and brand new trading mode have made it challenging to devising an acceptable automatically-generating strategy. This study proposes a framework for automatic high-frequency bitcoin transactions based on a deep reinforcement learning algorithm-proximal policy optimization (PPO). The framework creatively regards the transaction process as actions, returns as awards and prices as states to align with the idea of reinforcement learning. It com…
The theory of optimal trading under proportional transaction costs has been considered from a variety of perspectives. In this paper, we show that all the results can be interpreted using a universal law, illustrating the results in trading algorithm design.
We prove the existence of an equilibrium in a model with transaction costs and price impact where two agents are incentivized to trade towards a target. The two types of frictions -- price impact and transaction costs -- lead the agents to two distinct changes in their optimal investment approach: price impact causes agents to continuously trade in smaller amounts, while transaction costs cause the agents to cease trading before the end of the trading period. As the agents lose wealth because of transaction costs, the exchange makes a profit. We prove the existence of a strictly positive optim…
In the present work we develop a formalism to tackle the problem of optimal execution when trading market securities. More precisely, we introduce a utility function that balances market impact and timing risk, with this last being modelled as the very negative transaction costs incurred by our order execution. The framework is built upon existing theory on optimal trading strategies, but incorporates characteristics that enable distinctive execution strategies. The formalism is complemented by an analysis of various impact models and different distributional properties of market returns.
Optimal trading strategies for pairs trading have been studied by models that try to find either optimal shares of stocks by assuming no transaction costs or optimal timing of trading fixed numbers of shares of stocks with transaction costs. To find optimal strategies which determine optimally both trade times and number of shares in pairs trading process, we use a singular stochastic control approach to study an optimal pairs trading problem with proportional transaction costs. Assuming a cointegrated relationship for a pair of stock log-prices, we consider a portfolio optimization problem wh…
We study how transaction cost affects to the equilibrium return and optimal stock holdings in equilibrium. To this end, we develop a continuous-time risk-sharing model where heterogenous agents trade toward terminal target holdings subject to a quadratic transaction cost. The equilibrium stock holdings and trading rate under transaction cost are characterized by a unique solution to a forward-backward stochastic differential equation (FBSDE). The equilibrium return is also characterized as the unique solution of a system of coupled but linear FBSDEs.
Machine Learning-Based Bitcoin Trading Under Transaction Costs: Evidence From Walk-Forward Forecasting
Quantitative Finance Research Group, Faculty of Economic Sciences, University of Warsaw（经济科学学院量化金融研究组，华沙大学）；Quantitative Finance Research Group, Department of Quantitative Finance and Machine Learning, Faculty of Economic Sciences, University of Warsaw（经济科学学院量化金融与机器学习系量化金融研究组，华沙大学）
We model an informed agent with information about the future value of an asset trying to maximize profits when subjected to a transaction cost as well as a market maker tasked with setting fair transaction prices. In a single auction model, equilibrium is characterized by the unique root of a particular polynomial. Analysis of this polynomial with small levels of risk-aversion and transaction costs reveal a dimensionless parameter which captures several orders of asymptotic accuracy of the equilibrium behaviour. In a continuous time analogue of the single auction model, incorporation of a tran…
We study the optimal timing strategies for trading a mean-reverting price process with afinite deadline to enter and a separate finite deadline to exit the market. The price process is modeled by a diffusion with an affine drift that encapsulates a number of well-known models,including the Ornstein-Uhlenbeck (OU) model, Cox-Ingersoll-Ross (CIR) model, Jacobi model,and inhomogeneous geometric Brownian motion (IGBM) model.We analyze three types of trading strategies: (i) the long-short (long to open, short to close) strategy; (ii) the short-long(short to open, long to close) strategy, and (iii) …
We consider a Nash equilibrium between two high-frequency traders in a simple market impact model with transient price impact and additional quadratic transaction costs. Extending a result by Schöneborn (2008), we prove existence and uniqueness of the Nash equilibrium and show that for small transaction costs the high-frequency traders engage in a "hot-potato game", in which the same asset position is sold back and forth. We then identify a critical value for the size of the transaction costs above which all oscillations disappear and strategies become buy-only or sell-only. Numerical simulati…
Attempts to accurately measure the monetary velocity or related properties of bitcoin used in transactions have often attempted to either directly apply definitions from traditional macroeconomic theory or to use specialized metrics relative to the properties of the Blockchain like bitcoin days destroyed. In this paper, it is demonstrated that beyond being a useful metric, bitcoin days destroyed has mathematical properties that allow you to calculate the average dormancy (time since last use in a transaction) of the bitcoins used in transactions over a given time period. In addition, bitcoin d…
Our main task is to study the effect of corporate governance on the market liquidity of listed companies' stocks. We establish a theoretical model that contains the heterogeneity of investors' beliefs to explain the mechanisms by which corporate governance improves liquidity of the corporate stocks. In this process we found that the existence of noise traders who are semi-informed in the market is an important condition for corporate governance to have the effect of improving liquidity of the stocks. We further find that the strength of this effect is affected by the degree of noise traders' p…
Based on iterative optimization and activation function in deep learning, we proposed a new analytical framework of high-frequency trading information, that reduced structural loss in the assembly of Volume-synchronized probability of Informed Trading ($VPIN$), Generalized Autoregressive Conditional Heteroscedasticity (GARCH) and Support Vector Machine (SVM) to make full use of the order book information. Amongst the return acquisition procedure in market-making transactions, uncovering the relationship between discrete dimensional data from the projection of high-dimensional time-series would…
Stock trading based on Kelly's celebrated Expected Logarithmic Growth (ELG) criterion, a well-known prescription for optimal resource allocation, has received considerable attention in the literature. Using ELG as the performance metric, we compare the impact of trade execution delay on the relative performance of high-frequency trading versus buy and hold. While it is intuitively obvious and straightforward to prove that in the presence of sufficiently high transaction costs, buy and hold is the better strategy, is it possible that with no transaction costs, buy and hold can still be the bett…
Using elementary arguments, we show how to derive $\mathbf{L}_p$-error bounds for the approximation of frictionless wealth process in markets with proportional transaction costs. For utilities with bounded risk aversion, these estimates yield lower bounds for the frictional value function, which pave the way for its asymptotic analysis using stability results for viscosity solutions. Using tools from Malliavin calculus, we also derive simple sufficient conditions for the regularity of frictionless optimal trading strategies, the second main ingredient for the asymptotic analysis of small trans…
We present a formulation of the transaction cost analysis (TCA) in the Bayesian framework for the primary purpose of comparing broker algorithms using standardized benchmarks. Our formulation allows effective calculation of the expected value of trading benchmarks with only a finite sample of data relevant to practical applications. We discuss the nature of distribution of implementation shortfall, volume-weighted average price, participation-weighted price and short-term reversion benchmarks. Our model takes into account fat tails, skewness of the distributions and heteroscedasticity of bench…
We propose a convex formulation for a trading system with the Conditional Value-at-Risk as a risk-adjusted performance measure under the notion of Direct Reinforcement Learning. Due to convexity, the proposed approach can uncover a lucrative trading policy in a "pure" online manner where it can interactively learn and update the policy without multi-epoch training and validation. We assess our proposed algorithm on a real financial market where it trades one of the largest US trust funds, SPDR, for three years. Numerical experiments demonstrate the algorithm's robustness in detecting central m…
