We introduce a unified framework for rapid, large-scale portfolio optimization that incorporates both shrinkage and regularization techniques. This framework addresses multiple objectives, including minimum variance, mean-variance, and the maximum Sharpe ratio, and also adapts to various portfolio weight constraints. For each optimization scenario, we detail the translation into the corresponding quadratic programming (QP) problem and then integrate these solutions into a new open-source Python library. Using 50 years of return data from US mid to large-sized companies, and 33 distinct firm-specific characteristics, we utilize our framework to assess the out-of-sample monthly rebalanced portfolio performance of widely-adopted covariance matrix estimators and factor models, examining both daily and monthly returns. These estimators include the sample covariance matrix, linear and nonlinear shrinkage estimators, and factor portfolios based on Asset Pricing (AP) Trees, Principal Component Analysis (PCA), Risk Premium PCA (RP-PCA), and Instrumented PCA (IPCA). Our findings emphasize that AP-Trees and PCA-based factor models consistently outperform all other approaches in out-of-sample portfolio performance. Finally, we develop new l1 and l2 regularizations of factor portfolio norms which not only elevate the portfolio performance of AP-Trees and PCA-based factor models but they have a potential to reduce an excessive turnover and transaction costs often associated with these models.
I discuss some theoretical results with a view to motivate some practical choices in portfolio optimization. Even though the setting is not completely general (for example, the covariance matrix is assumed to be non-singular), I attempt to highlight the features that have practical relevance. The mathematical setting is Stochastic Portfolio Theory, which is flexible enough to describe most realistic assets, and it has been successfully employed for managing equity portfolios since 1987.
We consider the problem of finding the efficient frontier associated with the risk-return portfolio optimization model. We derive the analytical expression of the efficient frontier for a portfolio of N risky assets, and for the case when a risk-free asset is added to the model. Also, we provide an R implementation, and we discuss in detail a numerical example of a portfolio of several risky common stocks.
Community detection methods can be used to explore the structure of complex systems. The well-known modular configurations in complex financial systems indicate the existence of community structures. Here we analyze the community properties of correlation-based networks in worldwide stock markets and use community information to construct portfolios. Portfolios constructed using community detection methods perform well. Our results can be used as new portfolio optimization and risk management tools.
Although modern portfolio theory has been in existence for over 60 years, fund managers often struggle to get its models to produce reliable portfolio allocations without strongly constraining the decision vector by tight bands of strategic allocation targets. The two main root causes to this problem are inadequate parameter estimation and numerical artifacts. When both obstacles are overcome, portfolio models yield excellent allocations. In this paper, which is primarily aimed at practitioners, we discuss the most common mistakes in setting up portfolio models and in solving them algorithmica…
In this paper, we propose a market model with returns assumed to follow a multivariate normal tempered stable distribution defined by a mixture of the multivariate normal distribution and the tempered stable subordinator. This distribution is able to capture two stylized facts: fat-tails and asymmetry, that have been empirically observed for asset return distributions. On the new market model, we discuss a new portfolio optimization method, which is an extension of Markowitz's mean-variance optimization. The new optimization method considers not only reward and dispersion but also asymmetry. T…
Kelly's Criterion is well known among gamblers and investors as a method for maximizing the returns one would expect to observe over long periods of betting or investing. These ideas are conspicuously absent from portfolio optimization problems in the financial and automation literature. This paper will show how Kelly's Criterion can be incorporated into standard portfolio optimization models. The model developed here combines risk and return into a single objective function by incorporating a risk parameter. This model is then solved for a portfolio of 10 stocks from a major stock exchange us…
Risk aversion plays a significant and central role in investors' decisions in the process of developing a portfolio. In this framework of portfolio optimization we determine the portfolio that possesses the minimal risk by using a new geometrical method. For this purpose, we elaborate an algorithm that enables us to compute any generalized Euclidean distance to a standard simplex. With this new approach, we are able to treat the case of portfolio optimization without short-selling in its entirety, and we also recover in geometrical terms the well-known results on portfolio optimization with al…
In this paper we propose a cyclical coordinate descent (CCD) algorithm for solving high dimensional risk parity problems. We show that this algorithm converges and is very fast even with large covariance matrices (n > 500). Comparison with existing algorithms also shows that it is one of the most efficient algorithms.
We study portfolio optimization of four major cryptocurrencies. Our time series model is a generalized autoregressive conditional heteroscedasticity (GARCH) model with multivariate normal tempered stable (MNTS) distributed residuals used to capture the non-Gaussian cryptocurrency return dynamics. Based on the time series model, we optimize the portfolio in terms of Foster-Hart risk. Those sophisticated techniques are not yet documented in the context of cryptocurrency. Statistical tests suggest that the MNTS distributed GARCH model fits better with cryptocurrency returns than the competing GAR…
We consider the optimization of active extension portfolios. For this purpose, the optimization problem is rewritten as a stochastic programming model and solved using a clever multi-start local search heuristic, which turns out to provide stable solutions. The heuristic solutions are compared to optimization results of convex optimization solvers where applicable. Furthermore, the approach is applied to solve problems with non-convex risk measures, most notably to minimize Value-at-Risk. Numerical results using data from both the Dow Jones Industrial Average as well as the DAX 30 are shown.
We study the design of portfolios under a minimum risk criterion. The performance of the optimized portfolio relies on the accuracy of the estimated covariance matrix of the portfolio asset returns. For large portfolios, the number of available market returns is often of similar order to the number of assets, so that the sample covariance matrix performs poorly as a covariance estimator. Additionally, financial market data often contain outliers which, if not correctly handled, may further corrupt the covariance estimation. We address these shortcomings by studying the performance of a hybrid …
We investigate the portfolio selection problem against the systemic risk which is measured by CoVaR. We first demonstrate that the systemic risk of pure stock portfolios is essentially uncontrollable due to the contagion effect and the seesaw effect. Next, we prove that it is necessary and sufficient to introduce options to make the systemic risk controllable by the correlation hedging and the extreme loss hedging. In addition to systemic risk control, we show that using options can also enhance return-risk performance. Then, with a reasonable approximation of the conditional distribution of o…
In this paper we investigate the expected terminal utility maximization approach for a dynamic stochastic portfolio optimization problem. We solve it numerically by solving an evolutionary Hamilton-Jacobi-Bellman equation which is transformed by means of the Riccati transformation. We examine the dependence of the results on the shape of a chosen utility function in regard to the associated risk aversion level. We define the Conditional value-at-risk deviation ($CVaRD$) based Sharpe ratio for measuring risk-adjusted performance of a dynamic portfolio. We compute optimal strategies for a portfo…
We introduce a generic solver for dynamic portfolio allocation problems when the market exhibits return predictability, price impact and partial observability. We assume that the price modeling can be encoded into a linear state-space and we demonstrate how the problem then falls into the LQG framework. We derive the optimal control policy and introduce analytical tools that preserve the intelligibility of the solution. Furthermore, we link the existence and uniqueness of the optimal controller to a dynamical non-arbitrage criterion. Finally, we illustrate our method using a synthetic portfoli…
Prediction models are traditionally optimized independently from their use in the asset allocation decision-making process. We address this shortcoming and present a framework for integrating regression prediction models in a mean-variance optimization (MVO) setting. Closed-form analytical solutions are provided for the unconstrained and equality constrained MVO case. For the general inequality constrained case, we make use of recent advances in neural-network architecture for efficient optimization of batch quadratic-programs. To our knowledge, this is the first rigorous study of integrating …
This paper introduces a new functional optimization approach to portfolio optimization problems by treating the unknown weight vector as a function of past values instead of treating them as fixed unknown coefficients in the majority of studies. We first show that the optimal solution, in general, is not a constant function. We give the optimal conditions for a vector function to be the solution, and hence give the conditions for a plug-in solution (replacing the unknown mean and variance by certain estimates based on past values) to be optimal. After showing that the plug-in solutions are sub…
We consider an investor facing a classical portfolio problem of optimal investment in a log-Brownian stock and a fixed-interest bond, but constrained to choose portfolio and consumption strategies that reduce a dynamic shortfall risk measure. For continuous- and discrete-time financial markets we investigate the loss in expected utility of intermediate consumption and terminal wealth caused by imposing a dynamic risk constraint. We derive the dynamic programming equations for the resulting stochastic optimal control problems and solve them numerically. Our numerical results indicate that the l…
Energy markets are strategic to governments and economic development. Several commodities compete as substitutable energy sources and energy diversifiers. Such competition reduces the energy vulnerability of countries as well as portfolios' risk exposure. Vulnerability results mainly from price trends and fluctuations, following supply and demand shocks. Such energy price uncertainty attracts many market participants in the energy commodity markets. First, energy producers and consumers hedge adverse price changes with energy derivatives. Second, financial market participants use commodities a…
We employ model predictive control for a multi-period portfolio optimization problem. In addition to the mean-variance objective, we construct a portfolio whose allocation is given by model predictive control with a risk-parity objective, and provide a successive convex program algorithm that provides 30 times faster and robust solutions in the experiments. Computational results on the multi-asset universe show that multi-period models perform better than their single period counterparts in out-of-sample period, 2006-2020. The out-of-sample risk-adjusted performance of both mean-variance and r…
In this work, we consider the optimal portfolio selection problem under hard constraints on trading amounts, transaction costs and different rates for borrowing and lending when the risky asset returns are serially correlated. No assumptions about the correlation structure between different time points or about the distribution of the asset returns are needed. The problem is stated as a dynamic tracking problem of a reference portfolio with desired return. Our approach is tested on a set of a real data from Russian Stock Exchange MICEX.
In this study, we propose a new multi-objective portfolio optimization with idiosyncratic and systemic risks for financial networks. The two risks are measured by the idiosyncratic variance and the network clustering coefficient derived from the asset correlation networks, respectively. We construct three types of financial networks in which nodes indicate assets and edges are based on three correlation measures. Starting from the multi-objective model, we formulate and solve the asset allocation problem. We find that the optimal portfolios obtained through the multi-objective with networked a…
In this paper, we use replica analysis to investigate the influence of correlation among the return rates of assets on the solution of the portfolio optimization problem. We consider the behavior of the optimal solution for the case where the return rate is described with a single-factor model and compare the findings obtained from our proposed methods with correlated return rates with those obtained with independent return rates. We then analytically assess the increase in the investment risk when correlation is included. Furthermore, we also compare our approach with analytical procedures fo…
We discuss a class of risk-sensitive portfolio optimization problems. We consider the portfolio optimization model investigated by Nagai in 2003. The model by its nature can include fixed income securities as well in the portfolio. Under fairly general conditions, we prove the existence of optimal portfolio in both finite and infinite horizon problems.
Instead of controlling "symmetric" risks measured by central moments of investment return or terminal wealth, more and more portfolio models have shifted their focus to manage "asymmetric" downside risks that the investment return is below certain threshold. Among the existing downside risk measures, the lower-partial moments (LPM) and conditional value-at-risk (CVaR) are probably most promising. In this paper we investigate the dynamic mean-LPM and mean-CVaR portfolio optimization problems in continuous-time, while the current literature has only witnessed their static versions. Our contribut…
In this paper, different approaches to portfolio optimization having higher moments such as skewness and kurtosis are classified so that the reader can observe different paradigms and approaches in this field of research which is essential for practitioners in Hedge Funds in particular. Several methods based on different paradigms such as utility approach and multi-objective optimization are reviewed and the advantage and disadvantageous of these ideas are explained. Keywords: multi-objective optimization, portfolio optimization, scalarization, utility
We prove a general duality result for multi-stage portfolio optimization problems in markets with proportional transaction costs. The financial market is described by Kabanov's model of foreign exchange markets over a finite probability space and finite-horizon discrete time steps. This framework allows us to compare vector-valued portfolios under a partial ordering, so that our model does not require liquidation into some numeraire at terminal time. We embed the vector-valued portfolio problem into the set-optimization framework, and generate a problem dual to portfolio optimization. Using re…
This paper proposes analytic forms of portfolio CoVaR and CoCVaR on the normal tempered stable market model. Since CoCVaR captures the relative risk of the portfolio with respect to a benchmark return, we apply it to the relative portfolio optimization. Moreover, we derive analytic forms for the marginal contribution to CoVaR and the marginal contribution to CoCVaR. We discuss the Monte-Carlo simulation method to calculate CoCVaR and the marginal contributions of CoVaR and CoCVaR. As the empirical illustration, we show relative portfolio optimization with thirty stocks under the distress condi…
In this paper we develop a concrete and fully implementable approach to the optimization of functionally generated portfolios in stochastic portfolio theory. The main idea is to optimize over a family of rank-based portfolios parameterized by an exponentially concave function on the unit interval. This choice can be motivated by the long term stability of the capital distribution observed in large equity markets, and allows us to circumvent the curse of dimensionality. The resulting optimization problem, which is convex, allows for various regularizations and constraints to be imposed on the g…
We examine machine learning and factor-based portfolio optimization. We find that factors based on autoencoder neural networks exhibit a weaker relationship with commonly used characteristic-sorted portfolios than popular dimensionality reduction techniques. Machine learning methods also lead to covariance and portfolio weight structures that diverge from simpler estimators. Minimum-variance portfolios using latent factors derived from autoencoders and sparse methods outperform simpler benchmarks in terms of risk minimization. These effects are amplified for investors with an increased sensiti…
One of the reasons that higher order moment portfolio optimization methods are not fully used by practitioners in investment decisions is the complexity that these higher moments create by making the optimization problem nonconvex. Many few methods and theoretical results exists in the literature, but the present paper uses the method of successive convex approximation for the mean-variance-skewness problem.
Market conditions change continuously. However, in portfolio's investment strategies, it is hard to account for this intrinsic non-stationarity. In this paper, we propose to address this issue by using the Inverse Covariance Clustering (ICC) method to identify inherent market states and then integrate such states into a dynamic portfolio optimization process. Extensive experiments across three different markets, NASDAQ, FTSE and HS300, over a period of ten years, demonstrate the advantages of our proposed algorithm, termed Inverse Covariance Clustering-Portfolio Optimization (ICC-PO). The core…
In this paper Portfolio Optimization techniques were used to determine the most favorable investment portfolio. In particular, stock indices of three companies, namely Microsoft Corporation, Christian Dior Fashion House and Shevron Corporation were evaluated. Using this data the amounts invested in each asset when a portfolio is chosen on the efficient frontier were calculated. In addition, the Portfolio with minimum variance, tangency portfolio and optimal Markowitz portfolio are presented.
We consider the problem of portfolio optimization with a correlation constraint. The framework is the multiperiod stochastic financial market setting with one tradable stock, stochastic income and a non-tradable index. The correlation constraint is imposed on the portfolio and the non-tradable index at some benchmark time horizon. The goal is to maximize portofolio's expected exponential utility subject to the correlation constraint. Two types of optimal portfolio strategies are considered: the subgame perfect and the precommitment ones. We find analytical expressions for the constrained subga…
In this paper we present an evolutionary optimization approach to solve the risk parity portfolio selection problem. While there exist convex optimization approaches to solve this problem when long-only portfolios are considered, the optimization problem becomes non-trivial in the long-short case. To solve this problem, we propose a genetic algorithm as well as a local search heuristic. This algorithmic framework is able to compute solutions successfully. Numerical results using real-world data substantiate the practicability of the approach presented in this paper.
This paper investigates performance attribution measures as a basis for constraining portfolio optimization. We employ optimizations that minimize expected tail loss and investigate both asset allocation (AA) and the selection effect (SE) as hard constraints on asset weights. The test portfolio consists of stocks from the Dow Jones Industrial Average index; the benchmark is an equi-weighted portfolio of the same stocks. Performance of the optimized portfolios is judged using comparisons of cumulative price and the risk-measures maximum drawdown, Sharpe ratio, and Rachev ratio. The results sugg…
Using daily returns of the S&P 500 stocks from 2001 to 2011, we perform a backtesting study of the portfolio optimization strategy based on the extreme risk index (ERI). This method uses multivariate extreme value theory to minimize the probability of large portfolio losses. With more than 400 stocks to choose from, our study seems to be the first application of extreme value techniques in portfolio management on a large scale. The primary aim of our investigation is the potential of ERI in practice. The performance of this strategy is benchmarked against the minimum variance portfolio and the…
Minimum-variance portfolio optimizations rely on accurate covariance estimator to obtain optimal portfolios. However, it usually suffers from large error from sample covariance matrix when the sample size $n$ is not significantly larger than the number of assets $p$. We analyze the random matrix aspects of portfolio optimization and identify the order of errors in sample optimal portfolio weight and show portfolio risk are underestimated when using samples. We also provide LoCoV (low dimension covariance voting) algorithm to reduce error inherited from random samples. From various experiments,…
We introduce a robust variant of the Kelly portfolio optimization model, called the Wasserstein-Kelly portfolio optimization. Our model, taking a Wasserstein distributionally robust optimization (DRO) formulation, addresses the fundamental issue of estimation error in Kelly portfolio optimization by defining a ``ball" of distributions close to the empirical return distribution using the Wasserstein metric and seeking a robust log-optimal portfolio against the worst-case distribution from the Wasserstein ball. Enhancing the Kelly portfolio using Wasserstein DRO is a natural step to take, given …
Growth-optimal portfolios are guaranteed to accumulate higher wealth than any other investment strategy in the long run. However, they tend to be risky in the short term. For serially uncorrelated markets, similar portfolios with more robust guarantees have been recently proposed. This paper extends these robust portfolios by accommodating non-zero autocorrelations that may reflect investors' beliefs about market movements. Moreover, we prove that the risk incurred by such autocorrelations can be absorbed by modifying the covariance matrix of asset returns.
We consider the problem of choosing an optimal portfolio, assuming the asset returns have a Gaussian mixture (GM) distribution, with the objective of maximizing expected exponential utility. In this paper we show that this problem is convex, and readily solved exactly using domain-specific languages for convex optimization, without the need for sampling or scenarios. We then show how the closely related problem of minimizing entropic value at risk can also be formulated as a convex optimization problem.
In this paper we consider an interval portfolio selection problem with uncertain returns and introduce an inclusive concept of satisfaction index for interval inequality relation. Based on the satisfaction index, we propose an approach to reduce the interval programming problem with uncertain objective and constraints into a standard linear programming problem with two parameters. We showed by simulation experiment that our method is capable of helping investors to find efficient portfolios according to their preference.
We discuss - in what is intended to be a pedagogical fashion - generalized "mean-to-risk" ratios for portfolio optimization. The Sharpe ratio is only one example of such generalized "mean-to-risk" ratios. Another example is what we term the Fano ratio (which, unlike the Sharpe ratio, is independent of the time horizon). Thus, for long-only portfolios optimizing the Fano ratio generally results in a more diversified and less skewed portfolio (compared with optimizing the Sharpe ratio). We give an explicit algorithm for such optimization. We also discuss (Fano-ratio-inspired) long-short strategi…
This paper studies the portfolio optimization problem when the investor's utility is general and the return and volatility of the risky asset are fast mean-reverting, which are important to capture the fast-time scale in the modeling of stock price volatility. Motivated by the heuristic derivation in [J.-P. Fouque, R. Sircar and T. Zariphopoulou, \emph{Mathematical Finance}, 2016], we propose a zeroth order strategy, and show its asymptotic optimality within a specific (smaller) family of admissible strategies under proper assumptions. This optimality result is achieved by establishing a first…
A fractal approach to the long-short portfolio optimization is proposed. The algorithmic system based on the composition of market-neutral spreads into a single entity was considered. The core of the optimization scheme is a fractal walk model of returns, optimizing a risk aversion according to the investment horizon. The covariance matrix of spread returns has been used for the optimization and modified according to the Hurst stability analysis. Out-of-sample performance data has been represented for the space of exchange traded funds in five period time period of observation. The considered …
The least squares Monte Carlo algorithm has become popular for solving portfolio optimization problems. A simple approach is to approximate the value functions on a discrete grid of portfolio weights, then use control regression to generalize the discrete estimates. However, the classical global control regression can be expensive and inaccurate. To overcome this difficulty, we introduce a local control regression technique, combined with adaptive grids. We show that choosing a coarse grid for local regression can produce sufficiently accurate results.
