This paper proposes a machine learning-based framework for asset selection and portfolio construction, termed the Best-Path Algorithm Sparse Graphical Model (BPASGM). The method extends the Best-Path Algorithm (BPA) by mapping linear and non-linear dependencies among a large set of financial assets into a sparse graphical model satisfying a structural Markov property. Based on this representation, BPASGM performs a dependence-driven screening that removes positively or redundantly connected assets, isolating subsets that are conditionally independent or negatively correlated. This step is designed to enhance diversification and reduce estimation error in high-dimensional portfolio settings. Portfolio optimization is then conducted on the selected subset using standard mean-variance techniques. BPASGM does not aim to improve the theoretical mean-variance optimum under known population parameters, but rather to enhance realized performance in finite samples, where sample-based Markowitz portfolios are highly sensitive to estimation error. Monte Carlo simulations show that BPASGM-based portfolios achieve more stable risk-return profiles, lower realized volatility, and superior risk-adjusted performance compared to standard mean-variance portfolios. Empirical results for U.S. equities, global stock indices, and foreign exchange rates over 1990-2025 confirm these findings and demonstrate a substantial reduction in portfolio cardinality. Overall, BPASGM offers a statistically grounded and computationally efficient framework that integrates sparse graphical modeling with portfolio theory for dependence-aware asset selection.
Hedge funds have long been viewed as a veritable "black box" of investing since outsiders may never view the exact composition of portfolio holdings. Therefore, the ability to estimate an informative set of asset weights is highly desirable for analysis. We present a compositional state space model for estimation of an investment portfolio's unobserved asset allocation weightings on a set of candidate assets when the only observed information is the time series of portfolio returns and the candidate asset returns. In this paper, we exhibit both sequential Monte Carlo numerical and conditionall…
Using daily returns of the S&P 500 stocks from 2001 to 2011, we perform a backtesting study of the portfolio optimization strategy based on the extreme risk index (ERI). This method uses multivariate extreme value theory to minimize the probability of large portfolio losses. With more than 400 stocks to choose from, our study seems to be the first application of extreme value techniques in portfolio management on a large scale. The primary aim of our investigation is the potential of ERI in practice. The performance of this strategy is benchmarked against the minimum variance portfolio and the…
The principal portfolios of the standard Capital Asset Pricing Model (CAPM) are analyzed and found to have remarkable hedging and leveraging properties. Principal portfolios implement a recasting of any correlated asset set of N risky securities into an equivalent but uncorrelated set when short sales are allowed. While a determination of principal portfolios in general requires a detailed knowledge of the covariance matrix for the asset set, the rather simple structure of CAPM permits an accurate solution for any reasonably large asset set that reveals interesting universal properties. Thus f…
Portfolio optimization is one of the essential fields of focus in finance. There has been an increasing demand for novel computational methods in this area to compute portfolios with better returns and lower risks in recent years. We present a novel computational method called Representation Portfolio Selection (RPS) by redefining the distance matrix of financial assets using Representation Learning and Clustering algorithms for portfolio selection to increase diversification. RPS proposes a heuristic for getting closer to the optimal subset of assets. Using empirical results in this paper, we…
Schumpeter School of Business and Economics（熊彼特商业与经济学院）；University of Wuppertal（伍珀塔尔大学）
This paper proposes a Deep Reinforcement Learning algorithm for financial portfolio trading based on Deep Q-learning. The algorithm is capable of trading high-dimensional portfolios from cross-sectional datasets of any size which may include data gaps and non-unique history lengths in the assets. We sequentially set up environments by sampling one asset for each environment while rewarding investments with the resulting asset's return and cash reservation with the average return of the set of assets. This enforces the agent to strategically assign capital to assets that it predicts to perform …
We employ perturbation analysis technique to study multi-asset portfolio optimisation with transaction cost. We allow for correlations in risky assets and obtain optimal trading methods for general utility functions. Our analytical results are supported by numerical simulations in the context of the Long Term Growth Model.
University of the Witwatersrand（金山大学）；University of Johannesburg（约翰内斯堡大学）；Institute for Intelligent Systems（智能系统研究所）
The fusion of public sentiment data in the form of text with stock price prediction is a topic of increasing interest within the financial community. However, the research literature seldom explores the application of investor sentiment in the Portfolio Selection problem. This paper aims to unpack and develop an enhanced understanding of the sentiment aware portfolio selection problem. To this end, the study uses a Semantic Attention Model to predict sentiment towards an asset. We select the optimal portfolio through a sentiment-aware Long Short Term Memory (LSTM) recurrent neural network for …
It is well known that there are asymmetric dependence structures between financial returns. In this paper we use a new nonparametric measure of local dependence, the local Gaussian correlation, to improve portfolio allocation. We extend the classical mean-variance framework, and show that the portfolio optimization is straightforward using our new approach, only relying on a tuning parameter (the bandwidth). The new method is shown to outperform the equally weighted (1/N) portfolio and the classical Markowitz portfolio for monthly asset returns data.
We extend the Annually Recalculated Virtual Annuity (ARVA) spending rule for retirement savings decumulation to include a cap and a floor on withdrawals. With a minimum withdrawal constraint, the ARVA strategy runs the risk of depleting the investment portfolio. We determine the dynamic asset allocation strategy which maximizes a weighted combination of expected total withdrawals (EW) and expected shortfall (ES), defined as the average of the worst five per cent of the outcomes of real terminal wealth. We compare the performance of our dynamic strategy to simpler alternatives which maintain co…
Traditional approaches to financial asset allocation start with returns forecasting followed by an optimization stage that decides the optimal asset weights. Any errors made during the forecasting step reduce the accuracy of the asset weightings, and hence the profitability of the overall portfolio. The Portfolio Transformer (PT) network, introduced here, circumvents the need to predict asset returns and instead directly optimizes the Sharpe ratio, a risk-adjusted performance metric widely used in practice. The PT is a novel end-to-end portfolio optimization framework, inspired by the numerous…
The high sensitivity of optimized portfolios to estimation errors has prevented their practical application. To mitigate this sensitivity, we propose a new portfolio model called a Deeply Equal-Weighted Subset Portfolio (DEWSP). DEWSP is a subset of top-N ranked assets in an asset universe, the members of which are selected based on the predicted returns from deep learning algorithms and are equally weighted. Herein, we evaluate the performance of DEWSPs of different sizes N in comparison with the performance of other types of portfolios such as optimized portfolios and historically equal-weig…
We apply numerical dynamic programming techniques to solve discrete-time multi-asset dynamic portfolio optimization problems with proportional transaction costs and shorting/borrowing constraints. Examples include problems with multiple assets, and many trading periods in a finite horizon problem. We also solve dynamic stochastic problems, with a portfolio including one risk-free asset, an option, and its underlying risky asset, under the existence of transaction costs and constraints. These examples show that it is now tractable to solve such problems.
The conventional wisdom of mean-variance (MV) portfolio theory asserts that the nature of the relationship between risk and diversification is a decreasing asymptotic function, with the asymptote approximating the level of portfolio systematic risk or undiversifiable risk. This literature assumes that investors hold an equally-weighted or a MV portfolio and quantify portfolio diversification using portfolio size. However, the equally-weighted portfolio and portfolio size are MV optimal if and only if asset returns distribution is exchangeable or investors have no useful information about asset…
The main contribution of the paper is to employ the financial market network as a useful tool to improve the portfolio selection process, where nodes indicate securities and edges capture the dependence structure of the system. Three different methods are proposed in order to extract the dependence structure between assets in a network context. Starting from this modified structure, we formulate and then we solve the asset allocation problem. We find that the portfolios obtained through a network-based approach are composed mainly of peripheral assets, which are poorly connected with the other…
Portfolio management problems are often divided into two types: active and passive, where the objective is to outperform and track a preselected benchmark, respectively. Here, we formulate and solve a dynamic asset allocation problem that combines these two objectives in a unified framework. We look to maximize the expected growth rate differential between the wealth of the investor's portfolio and that of a performance benchmark while penalizing risk-weighted deviations from a given tracking portfolio. Using stochastic control techniques, we provide explicit closed-form expressions for the op…
The portfolio optimization problem in which the variances of the return rates of assets are not identical is analyzed in this paper using the methodology of statistical mechanical informatics, specifically, replica analysis. We define two characteristic quantities of an optimal portfolio, namely, minimal investment risk and concentrated investment level, in order to solve the portfolio optimization problem and analytically determine their asymptotical behaviors using replica analysis. Moreover, numerical experiments were performed, and a comparison between the results of our simulation and tho…
Classical mean-variance portfolio theory tells us how to construct a portfolio of assets which has the greatest expected return for a given level of return volatility. Utility theory then allows an investor to choose the point along this efficient frontier which optimally balances her desire for excess expected return against her reluctance to bear risk. The means and covariances of the distributions of future asset returns are assumed to be known, so the only source of uncertainty is the stochastic piece of the price evolution. In the real world, we have another source of uncertainty - we est…
This paper proposes a new method for financial portfolio optimization based on reducing simultaneous asset shocks across a collection of assets. This may be understood as an alternative approach to risk reduction in a portfolio based on a new mathematical quantity. First, we apply recently introduced semi-metrics between finite sets to determine the distance between time series' structural breaks. Then, we build on the classical portfolio optimization theory of Markowitz and use this distance between asset structural breaks for our penalty function, rather than portfolio variance. Our experime…
We show how to reduce the problem of computing VaR and CVaR with Student T return distributions to evaluation of analytical functions of the moments. This allows an analysis of the risk properties of systems to be carefully attributed between choices of risk function (e.g. VaR vs CVaR); choice of return distribution (power law tail vs Gaussian) and choice of event frequency, for risk assessment. We exploit this to provide a simple method for portfolio optimization when the asset returns follow a standard multivariate T distribution. This may be used as a semi-analytical verification tool for m…
This article develops a model that takes into account skewness risk in risk parity portfolios. In this framework, asset returns are viewed as stochastic processes with jumps or random variables generated by a Gaussian mixture distribution. This dual representation allows us to show that skewness and jump risks are equivalent. As the mixture representation is simple, we obtain analytical formulas for computing asset risk contributions of a given portfolio. Therefore, we define risk budgeting portfolios and derive existence and uniqueness conditions. We then apply our model to the equity/bond/vo…
Diversification return is an incremental return earned by a rebalanced portfolio of assets. The diversification return of a rebalanced portfolio is often incorrectly ascribed to a reduction in variance. We argue that the underlying source of the diversification return is the rebalancing, which forces the investor to sell assets that have appreciated in relative value and buy assets that have declined in relative value, as measured by their weights in the portfolio. In contrast, the incremental return of a buy-and-hold portfolio is driven by the fact that the assets that perform the best become…
The Sharpe ratio is a way to compare the excess returns (over the risk free asset) of portfolios for each unit of volatility that is generated by a portfolio. In this paper we introduce a robust Sharpe ratio portfolio under the assumption that the risk free asset is unknown. We propose a robust portfolio that maximizes the Sharpe ratio when the risk free asset is unknown, but is within a given interval. To compute the best Sharpe ratio portfolio all the Sharpe ratios for any risk free asset are considered and compared by using the so-called cross-efficiency evaluation. An explicit expression o…
We investigate the use of Kelly's strategy in the construction of an optimal portfolio of assets. For lognormally distributed asset returns, we derive approximate analytical results for the optimal investment fractions in various settings. We show that when mean returns and volatilities of the assets are small and there is no risk-free asset, the Kelly-optimal portfolio lies on Markowitz Efficient Frontier. Since in the investigated case the Kelly approach forbids short positions and borrowing, often only a small fraction of the available assets is included in the Kelly-optimal portfolio. This…
The investment economy is a main characteristic of prosperous society. The investment portfolio management is a main financial problem, which has to be solved by the investment, commercial and central banks with the application of modern portfolio theory in the investment economy. We use the learning analytics together with the integrative creative imperative intelligent conceptual co-lateral adaptive thinking with the purpose to advance our scientific knowledge on the diversified investment portfolio management in the nonlinear dynamic financial system. We apply the econophysics principles an…
The investment risk minimization problem with budget and return constraints has been the subject of research using replica analysis but there are shortcomings in the extant literature. With respect to Tobin's separation theorem and the capital asset pricing model, it is necessary to investigate the implications of a risk-free asset and examine its influence on the optimal portfolio. Accordingly, in this work, we explore the investment risk minimization problem in the presence of a risk-free asset with budget and return constraints. Moreover, we discuss opportunity loss, the Pythagorean theorem…
Given a set of assets and an investment capital, the classical portfolio selection problem consists in determining the amount of capital to be invested in each asset in order to build the most profitable portfolio. The portfolio optimization problem is naturally modeled as a mean-risk bi-criteria optimization problem where the mean rate of return of the portfolio must be maximized whereas a given risk measure must be minimized. Several mathematical programming models and techniques have been presented in the literature in order to efficiently solve the portfolio problem. A relatively recent pr…
We propose a novel risk matrix to characterize the optimal portfolio choice of an investor with tail concerns. The diagonal of the matrix contains the Value-at-Risk of each asset in the portfolio and the off-diagonal the pairwise Delta-CoVaR measures reflecting tail connections between assets. First, we derive the conditions under which the associated quadratic risk function has a closed-form solution. Second, we examine the relationship between portfolio risk and eigenvector centrality. Third, we show that portfolio risk is not necessarily increasing with respect to stock centrality. Forth, w…
Oxford-Man Institute of Quantitative Finance（牛津-曼量化金融研究院）；University of Oxford（牛津大学）
We adopt deep learning models to directly optimise the portfolio Sharpe ratio. The framework we present circumvents the requirements for forecasting expected returns and allows us to directly optimise portfolio weights by updating model parameters. Instead of selecting individual assets, we trade Exchange-Traded Funds (ETFs) of market indices to form a portfolio. Indices of different asset classes show robust correlations and trading them substantially reduces the spectrum of available assets to choose from. We compare our method with a wide range of algorithms with results showing that our mo…
In the market place, diversification reduces risk and provides protection against extreme events by ensuring that one is not overly exposed to individual occurrences. We argue that diversification is best measured by characteristics of the combined portfolio of assets and introduce a measure based on the information entropy of the probability distribution for the final portfolio asset value. For Gaussian assets the measure is a logarithmic function of the variance and combining independent Gaussian assets of equal variance adds an amount to the diversification. The advantages of this measure i…
In this paper, we document a novel machine learning based bottom-up approach for static and dynamic portfolio optimization on, potentially, a large number of assets. The methodology applies to general constrained optimization problems and overcomes many major difficulties arising in current optimization schemes. Taking mean-variance optimization as an example, we no longer need to compute the covariance matrix and its inverse, therefore the method is immune from the estimation error on this quantity. Moreover, no explicit calls of optimization routines are needed. Applications to equity portfo…
Several portfolio selection models take into account practical limitations on the number of assets to include and on their weights in the portfolio. We present here a study of the Limited Asset Markowitz (LAM), of the Limited Asset Mean Absolute Deviation (LAMAD) and of the Limited Asset Conditional Value-at-Risk (LACVaR) models, where the assets are limited with the introduction of quantity and cardinality constraints. We propose a completely new approach for solving the LAM model, based on reformulation as a Standard Quadratic Program and on some recent theoretical results. With this approac…
We consider the problem of optimizing a portfolio of financial assets, where the number of assets can be much larger than the number of observations. The optimal portfolio weights require estimating the inverse covariance matrix of excess asset returns, classical solutions of which behave badly in high-dimensional scenarios. We propose to use a regression-based joint shrinkage method for estimating the partial correlation among the assets. Extensive simulation studies illustrate the superior performance of the proposed method with respect to variance, weight, and risk estimation errors compare…
Management of the portfolios containing low liquidity assets is a tedious problem. The buyer proposes the price that can differ greatly from the paper value estimated by the seller, the seller, on the other hand, can not liquidate his portfolio instantly and waits for a more favorable offer. To minimize losses in this case we need to develop new methods. One of the steps moving the theory towards practical needs is to take into account the time lag of the liquidation of an illiquid asset. This task became especially significant for the practitioners in the time of the global financial crises. …
We consider the mean--variance portfolio optimization problem under the game theoretic framework and without risk-free assets. The problem is solved semi-explicitly by applying the extended Hamilton--Jacobi--Bellman equation. Although the coefficient of risk aversion in our model is a constant, the optimal amounts of money invested in each stock still depend on the current wealth in general. The optimal solution is obtained by solving a system of ordinary differential equations whose existence and uniqueness are proved and a numerical algorithm as well as its convergence speed are provided. Di…
The debate between active and passive investment strategies has been ongoing for many years and is far from being over. In this paper, we show that the choice of an optimal portfolio management strategy depends on an investment climate, which we measure via the parameters of the Heston model calibrated to the real stock market data. Depending on the values of those parameters, the passive strategy may namely outperform the active ones or vice versa. The method is tested on three stock market indices: S\&P500, DAX and WIG20.
Markowitz (1952, 1959) laid down the ground-breaking work on the mean-variance analysis. Under his framework, the theoretical optimal allocation vector can be very different from the estimated one for large portfolios due to the intrinsic difficulty of estimating a vast covariance matrix and return vector. This can result in adverse performance in portfolio selected based on empirical data due to the accumulation of estimation errors. We address this problem by introducing the gross-exposure constrained mean-variance portfolio selection. We show that with gross-exposure constraint the theoreti…
In behavioral finance, aversion affects investors' judgment of future uncertainty when profit and loss occur. Considering investors' aversion to loss and risk, and the ambiguous uncertainty characterizing asset returns, we construct a distributional robust portfolio model (DRP) under the condition that the distribution of risky asset returns is unknown. Specifically, our objective is to find an optimal portfolio of assets that maximizes the worst-case utility level on the Wasserstein ball, which is centered on the empirical distribution of sample returns and the radius of the ball quantifies t…
Zhejiang University（浙江大学）；Fudan University（复旦大学）；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；IBM Research（IBM研究院）
Portfolio management (PM) is a fundamental financial planning task that aims to achieve investment goals such as maximal profits or minimal risks. Its decision process involves continuous derivation of valuable information from various data sources and sequential decision optimization, which is a prospective research direction for reinforcement learning (RL). In this paper, we propose SARL, a novel State-Augmented RL framework for PM. Our framework aims to address two unique challenges in financial PM: (1) data heterogeneity -- the collected information for each asset is usually diverse, noisy…
This paper studies the investment decision of the Spanish households using a unique data set, the Spanish Survey of Household Finance (EFF). We propose a theoretical model in which households, given a fixed investment in housing, allocate their net wealth across bank time deposits, stocks, and mortgage. Besides considering housing as an indivisible and illiquid asset that restricts the portfolio choice decision, we take into account the financial constraints that households face when they apply for external funding. For every representative household in the EFF we solve this theoretical proble…
We introduce a new set of consistent measures of risks, in terms of the semi-invariants of pdf's, such that the centered moments and the cumulants of the portfolio distribution of returns that put more emphasis on the tail the distributions. We derive generalized efficient frontiers, based on these novel measures of risks and present the generalized CAPM, both in the cases of homogeneous and heterogeneous markets. Then, using a family of modified Weibull distributions, encompassing both sub-exponentials and super-exponentials, to parameterize the marginal distributions of asset returns and the…
Managing investment portfolios is an old and well know problem in multiple fields including financial mathematics and financial engineering as well as econometrics and econophysics. Multiple different concepts and theories were used so far to describe methods of handling with financial assets, including differential equations, stochastic calculus and advanced statistics. In this paper, using a set of tools from the probability theory, various strategies of building financial portfolios are analysed in different market conditions. A special attention is given to several realisations of a so cal…
It is well known that quantile regression model minimizes the portfolio extreme risk, whenever the attention is placed on the estimation of the response variable left quantiles. We show that, by considering the entire conditional distribution of the dependent variable, it is possible to optimize different risk and performance indicators. In particular, we introduce a risk-adjusted profitability measure, useful in evaluating financial portfolios under a pessimistic perspective, since the reward contribution is net of the most favorable outcomes. Moreover, as we consider large portfolios, we als…
ESG ratings provide a quantitative measure for socially responsible investment. We present a unified framework for incorporating numeric ESG ratings into dynamic pricing theory. Specifically, we introduce an ESG-valued return that is a linearly constrained transformation of financial return and ESG score. This leads to a more complex portfolio optimization problem in a space governed by reward, risk and ESG score. The framework preserves the traditional risk aversion parameter and introduces an ESG affinity parameter. We apply this framework to develop ESG-valued: portfolio optimization; capit…
Deep Reinforcement Learning for Investor-Specific Portfolio Optimization: A Volatility-Guided Asset Selection Approach
School of Mathematical and Statistical Sciences, Indian Institute of Technology Mandi（印度理工学院曼迪数学与统计科学学院）；Department of Mathematics, Indian Institute of Technology Guwahati（印度理工学院古瓦哈提数学系）
We consider the problem of finding the efficient frontier associated with the risk-return portfolio optimization model. We derive the analytical expression of the efficient frontier for a portfolio of N risky assets, and for the case when a risk-free asset is added to the model. Also, we provide an R implementation, and we discuss in detail a numerical example of a portfolio of several risky common stocks.
