We study the design of portfolios under a minimum risk criterion. The performance of the optimized portfolio relies on the accuracy of the estimated covariance matrix of the portfolio asset returns. For large portfolios, the number of available market returns is often of similar order to the number of assets, so that the sample covariance matrix performs poorly as a covariance estimator. Additionally, financial market data often contain outliers which, if not correctly handled, may further corrupt the covariance estimation. We address these shortcomings by studying the performance of a hybrid covariance matrix estimator based on Tyler's robust M-estimator and on Ledoit-Wolf's shrinkage estimator while assuming samples with heavy-tailed distribution. Employing recent results from random matrix theory, we develop a consistent estimator of (a scaled version of) the realized portfolio risk, which is minimized by optimizing online the shrinkage intensity. Our portfolio optimization method is shown via simulations to outperform existing methods both for synthetic and real market data.
In this paper, we present an extended exploratory continuous-time mean-variance framework for portfolio management. Our strategy involves a new clustering method based on simulated annealing, which allows for more practical asset selection. Additionally, we consider past wealth evolution when constructing the mean-variance portfolio. We found that our strategy effectively learns from the past and performs well in practice.
Value-at-Risk is one of the most popular risk management tools in the financial industry. Over the past 20 years several attempts to include VaR in the portfolio selection process have been proposed. However, using VaR as a risk measure in portfolio optimization models leads to problems that are computationally hard to solve. In view of this, few practical applications of VaR in portfolio selection have appeared in the literature up to now. In this paper, we propose to add the VaR criterion to the classical Mean-Variance approach in order to better address the typical regulatory constraints of…
In this paper we consider the worst-case model risk approach described in Glasserman and Xu (2014). Portfolio selection with model risk can be a challenging operational research problem. In particular, it presents an additional optimisation compared to the classical one. We find the analytical solution for the optimal mean-variance portfolio selection in the worst-case scenario approach. In the minimum-variance case, we prove that the analytical solution is significantly different from the one found numerically by Glasserman and Xu (2014) and that model risk reduces to an estimation risk. A de…
It is well known that the out-of-sample performance of Markowitz's mean-variance portfolio criterion can be negatively affected by estimation errors in the mean and covariance. In this paper we address the problem by regularizing the mean-variance objective function with a weighted elastic net penalty. We show that the use of this penalty can be motivated by a robust reformulation of the mean-variance criterion that directly accounts for parameter uncertainty. With this interpretation of the weighted elastic net penalty we derive data driven techniques for calibrating the weighting parameters …
We employ model predictive control for a multi-period portfolio optimization problem. In addition to the mean-variance objective, we construct a portfolio whose allocation is given by model predictive control with a risk-parity objective, and provide a successive convex program algorithm that provides 30 times faster and robust solutions in the experiments. Computational results on the multi-asset universe show that multi-period models perform better than their single period counterparts in out-of-sample period, 2006-2020. The out-of-sample risk-adjusted performance of both mean-variance and r…
Prediction models are traditionally optimized independently from their use in the asset allocation decision-making process. We address this shortcoming and present a framework for integrating regression prediction models in a mean-variance optimization (MVO) setting. Closed-form analytical solutions are provided for the unconstrained and equality constrained MVO case. For the general inequality constrained case, we make use of recent advances in neural-network architecture for efficient optimization of batch quadratic-programs. To our knowledge, this is the first rigorous study of integrating …
We consider a reference security, understood to be an attractive investment, with the caveat that an investor is not willing to directly invest in the security, for presence of constraints, either investor specific or pertaining to the security itself. The investor, however, is open to a portfolio constructed with an accepted set of securities, where returns could be considered similar to the reference security. We demonstrate, under a measure of similarity, such a portfolio could be selected with a mean-variance characterization, as defined by Markowitz. Furthermore, we consider the performan…
This paper introduces a new functional optimization approach to portfolio optimization problems by treating the unknown weight vector as a function of past values instead of treating them as fixed unknown coefficients in the majority of studies. We first show that the optimal solution, in general, is not a constant function. We give the optimal conditions for a vector function to be the solution, and hence give the conditions for a plug-in solution (replacing the unknown mean and variance by certain estimates based on past values) to be optimal. After showing that the plug-in solutions are sub…
Under mean-variance-utility framework, we propose a new portfolio selection model, which allows wealth and time both have influences on risk aversion in the process of investment. We solved the model under a game theoretic framework and analytically derived the equilibrium investment (consumption) policy. The results conform with the facts that optimal investment strategy heavily depends on the investor's wealth and future income-consumption balance as well as the continuous optimally consumption process is highly dependent on the consumption preference of the investor.
Motivated by empirical evidence for rough volatility models, this paper investigates continuous-time mean-variance (MV) portfolio selection under the Volterra Heston model. Due to the non-Markovian and non-semimartingale nature of the model, classic stochastic optimal control frameworks are not directly applicable to the associated optimization problem. By constructing an auxiliary stochastic process, we obtain the optimal investment strategy, which depends on the solution to a Riccati-Volterra equation. The MV efficient frontier is shown to maintain a quadratic curve. Numerical studies show t…
In portfolio analysis, the traditional approach of replacing population moments with sample counterparts may lead to suboptimal portfolio choices. I show that optimal portfolio weights can be estimated using a machine learning (ML) framework, where the outcome to be predicted is a constant and the vector of explanatory variables is the asset returns. It follows that ML specifically targets estimation risk when estimating portfolio weights, and that "off-the-shelf" ML algorithms can be used to estimate the optimal portfolio in the presence of parameter uncertainty. The framework nests the tradi…
We consider continuous-time mean-variance portfolio selection with bankruptcy prohibition under convex cone portfolio constraints. This is a long-standing and difficult problem not only because of its theoretical significance, but also for its practical importance. First of all, we transform the above problem into an equivalent mean-variance problem with bankruptcy prohibition without portfolio constraints. The latter is then treated using martingale theory. Our findings indicate that we can directly present the semi-analytical expressions of the pre-committed efficient mean-variance policy wi…
Energy markets are strategic to governments and economic development. Several commodities compete as substitutable energy sources and energy diversifiers. Such competition reduces the energy vulnerability of countries as well as portfolios' risk exposure. Vulnerability results mainly from price trends and fluctuations, following supply and demand shocks. Such energy price uncertainty attracts many market participants in the energy commodity markets. First, energy producers and consumers hedge adverse price changes with energy derivatives. Second, financial market participants use commodities a…
The problem of finding the optimal portfolio for investors is called the portfolio optimization problem. Such problem mainly concerns the expectation and variability of return (i.e., mean and variance). Although the variance would be the most fundamental risk measure to be minimized, it has several drawbacks. Conditional Value-at-Risk (CVaR) is a relatively new risk measure that addresses some of the shortcomings of well-known variance-related risk measures, and because of its computational efficiencies, it has gained popularity. CVaR is defined as the expected value of the loss that occurs be…
Given two random realized returns on an investment, which is to be preferred? This is a fundamental problem in finance that has no definitive solution except in the case one investment always returns more than the other. In 1952 Markowitz and Roy introduced the following criterion for risk vs. return in portfolio selection: if two portfolios have the same expected realized return then prefer the one with smaller variance. An efficient portfolio has the least variance among all portfolios having the same expected realized return. The primary contribution of this short note is observation that t…
The classical dynamic programming-based optimal stochastic control methods fail to cope with nonseparable dynamic optimization problems as the principle of optimality no longer applies in such situations. Among these notorious nonseparable problems, the dynamic mean-variance portfolio selection formulation had posted a great challenge to our research community until recently. A few solution methods, including the embedding scheme, have been developed in the last decade to solve the dynamic mean-variance portfolio selection formulation successfully. We propose in this paper a novel mean-field f…
The only input to attain the portfolio weights of global minimum variance portfolio (GMVP) is the covariance matrix of returns of assets being considered for investment. Since the population covariance matrix is not known, investors use historical data to estimate it. Even though sample covariance matrix is an unbiased estimator of the population covariance matrix, it includes a great amount of estimation error especially when the number of observed data is not much bigger than number of assets. As it is difficult to estimate the covariance matrix with high dimensionality all at once, clusteri…
We propose a virtual bidding strategy by modeling the price differences between the day-ahead market and the real-time market as Brownian motion with drift, where the drift rate and volatility are functions of meteorological variables. We then transform the virtual bidding problem into a mean-variance portfolio management problem, where we approach the mean-variance portfolio management problem by using the exploratory mean-variance portfolio management framework
The popularity of modern portfolio theory has decreased among practitioners because of its unfavorable out-of-sample performance. Estimation errors tend to affect the optimal weight calculation noticeably, especially when a large number of assets is considered. To overcome these issues, many methods have been proposed in recent years, although most only address a small set of practically relevant questions related to portfolio allocation. This study therefore sheds light on different covariance estimation techniques, combines them with sparse model approaches, and includes a turnover constrain…
Growth-optimal portfolios are guaranteed to accumulate higher wealth than any other investment strategy in the long run. However, they tend to be risky in the short term. For serially uncorrelated markets, similar portfolios with more robust guarantees have been recently proposed. This paper extends these robust portfolios by accommodating non-zero autocorrelations that may reflect investors' beliefs about market movements. Moreover, we prove that the risk incurred by such autocorrelations can be absorbed by modifying the covariance matrix of asset returns.
We study dynamic optimal portfolio allocation for monotone mean--variance preferences in a general semimartingale model. Armed with new results in this area we revisit the work of Cui, Li, Wang and Zhu (2012, MAFI) and fully characterize the circumstances under which one can set aside a non-negative cash flow while simultaneously improving the mean--variance efficiency of the left-over wealth. The paper analyzes, for the first time, the monotone hull of the Sharpe ratio and highlights its relevance to the problem at hand.
When we implement a portfolio selection methodology under a mean-risk formulation, it is essential to correctly model investors' risk aversion which may be time-dependent, or even state-dependent during the investment procedure. In this paper, we propose a behavior risk aversion model, which is a piecewise linear function of the current wealth level with a reference point at a preset investment target. Due to the time inconsistency of the resulting multi-period mean-variance model with an adaptive risk aversion, we investigate in this paper the time consistent behavior portfolio policy by solv…
Mean-variance portfolio decisions that combine prediction and optimisation have been shown to have poor empirical performance. Here, we consider the performance of various shrinkage methods by their efficient frontiers under different distributional assumptions to study the impact of reasonable departures from Normality. Namely, we investigate the impact of first-order auto-correlation, second-order auto-correlation, skewness, and excess kurtosis. We show that the shrinkage methods tend to re-scale the sample efficient frontier, which can change based on the nature of local perturbations from …
High precision analytical approximation is proposed for variance-covariance based risk allocation in a portfolio of risky assets. A general case of a single-period multi-factor Merton-type model with stochastic recovery is considered. The accuracy of the approximation as well as its speed are compared to and shown to be superior to those of Monte Carlo simulation.
The vector of periodic, compound returns of a typical investment portfolio is almost never a convex combination of the return vectors of the securities in the portfolio. As a result the ex post version of Harry Markowitz's "standard mean-variance portfolio selection model" does not apply to compound return data. We propose using notional portfolios and normalized linear returns to remedy this problem.
The mean-variance portfolio that considers the trade-off between expected return and risk has been widely used in the problem of asset allocation for multi-asset portfolios. However, since it is difficult to estimate the expected return and the out-of-sample performance of the mean-variance portfolio is poor, risk-based portfolio construction methods focusing only on risk have been proposed, and are attracting attention mainly in practice. In terms of risk, asset fluctuations that make up the portfolio are thought to have common factors behind them, and principal component analysis, which is a…
On Reference-Regulated Multiperiod Mean-Variance Portfolio Optimization in High Dimensions
Faculty of Business and Economics, The University of Hong Kong（香港大学工商管理学院）；School of Information Management and Engineering, Shanghai University of Finance and Economics（上海财经大学信息管理与工程学院）
In this paper, we study closed-loop equilibrium strategies for mean-variance portfolio selection problem in a hidden Markov model with dynamic attention behavior. In addition to the investment strategy, the investor's attention to news is introduced as a control of the accuracy of the news signal process. The objective is to find equilibrium strategies by numerically solving an extended HJB equation by using Markov chain approximation method. An iterative algorithm is constructed and its convergence is established. Numerical examples are also provided to illustrate the results.
We introduce a $k$-fold boosted version of our Boostrapped Average Hierarchical Clustering cleaning procedure for correlation and covariance matrices. We then apply this method to global minimum variance portfolios for various values of $k$ and compare their performance with other state-of-the-art methods. Generally, we find that our method yields better Sharpe ratios after transaction costs than competing filtering methods, despite requiring a larger turnover.
The discrete-time mean-variance portfolio selection formulation, a representative of general dynamic mean-risk portfolio selection problems, does not satisfy time consistency in efficiency (TCIE) in general, i.e., a truncated pre-committed efficient policy may become inefficient when considering the corresponding truncated problem, thus stimulating investors' irrational investment behavior. We investigate analytically effects of portfolio constraints on time consistency of efficiency for convex cone constrained markets. More specifically, we derive the semi-analytical expressions for the pre-c…
In this short report, we discuss how coordinate-wise descent algorithms can be used to solve minimum variance portfolio (MVP) problems in which the portfolio weights are constrained by $l_{q}$ norms, where $1\leq q \leq 2$. A portfolio which weights are regularised by such norms is called a sparse portfolio (Brodie et al.), since these constraints facilitate sparsity (zero components) of the weight vector. We first consider a case when the portfolio weights are regularised by a weighted $l_{1}$ and squared $l_{2}$ norm. Then two benchmark data sets (Fama and French 48 industries and 100 size a…
In the market place, diversification reduces risk and provides protection against extreme events by ensuring that one is not overly exposed to individual occurrences. We argue that diversification is best measured by characteristics of the combined portfolio of assets and introduce a measure based on the information entropy of the probability distribution for the final portfolio asset value. For Gaussian assets the measure is a logarithmic function of the variance and combining independent Gaussian assets of equal variance adds an amount to the diversification. The advantages of this measure i…
The optimization of the variance supplemented by a budget constraint and an asymmetric $\ell_1$ regularizer is carried out analytically by the replica method borrowed from the theory of disordered systems. The asymmetric regularizer allows us to penalize short and long positions differently, so the present treatment includes the no-short-constrained portfolio optimization problem as a special case. Results are presented for the out-of-sample and the in-sample estimator of the regularized variance, the relative estimation error, the density of the assets eliminated from the portfolio by the reg…
We consider monotone mean-variance (MMV) portfolio selection problems with a conic convex constraint under diffusion models, and their counterpart problems under mean-variance (MV) preferences. We obtain the precommitted optimal strategies to both problems in closed form and find that they coincide, without and with the presence of the conic constraint. This result generalizes the equivalence between MMV and MV preferences from non-constrained cases to a specific constrained case. A comparison analysis reveals that the orthogonality property under the conic convex set is a key to ensuring the …
In this paper, we study the mean-variance portfolio selection problem under partial information with drift uncertainty. First we show that the market model is complete even in this case while the information is not complete and the drift is uncertain. Then, the optimal strategy based on partial information is derived, which reduces to solving a related backward stochastic differential equation (BSDE). Finally, we propose an efficient numerical scheme to approximate the optimal portfolio that is the solution of the BSDE mentioned above. Malliavin calculus and the particle representation play im…
This paper considers the mean variance portfolio management problem. We examine portfolios which contain both primary and derivative securities. The challenge in this context is due to portfolio's nonlinearities. The delta-gamma approximation is employed to overcome it. Thus, the optimization problem is reduced to a well posed quadratic program. The methodology developed in this paper can be also applied to pricing and hedging in incomplete markets.
Understanding the Long-Only Minimum Variance Portfolio
Consortium for Data Analytics in Risk (CDAR), UC Berkeley（加州大学伯克利分校数据风险分析联盟）；Dept. of Mathematics, Florida State University and CDAR, UC Berkeley（佛罗里达州立大学数学系及加州大学伯克利分校数据风险分析联盟）；Dept. of Mathematics, Florida State University（佛罗里达州立大学数学系）
The paper Zhao et al. (2015) shows that mean-CVaR-skewness portfolio optimization problems based on asymetric Laplace (AL) distributions can be transformed into quadratic optimization problems under which closed form solutions can be found. In this note, we show that such result also holds for mean-risk-skewness portfolio optimization problems when the underlying distribution is a larger class of normal mean-variance mixture (NMVM) models than the class of AL distributions. We then study the value at risk (VaR) and conditional value at risk (CVaR) risk measures on portfolios of returns with NM…
The portfolio optimization problem in which the variances of the return rates of assets are not identical is analyzed in this paper using the methodology of statistical mechanical informatics, specifically, replica analysis. We define two characteristic quantities of an optimal portfolio, namely, minimal investment risk and concentrated investment level, in order to solve the portfolio optimization problem and analytically determine their asymptotical behaviors using replica analysis. Moreover, numerical experiments were performed, and a comparison between the results of our simulation and tho…
