Most existing work uses dual decomposition and subgradient methods to solve Network Utility Maximization (NUM) problems in a distributed manner, which suffer from slow rate of convergence properties. This work develops an alternative distributed Newton-type fast converging algorithm for solving network utility maximization problems with self-concordant utility functions. By using novel matrix splitting techniques, both primal and dual updates for the Newton step can be computed using iterative schemes in a decentralized manner with limited information exchange. Similarly, the stepsize can be obtained via an iterative consensus-based averaging scheme. We show that even when the Newton direction and the stepsize in our method are computed within some error (due to finite truncation of the iterative schemes), the resulting objective function value still converges superlinearly to an explicitly characterized error neighborhood. Simulation results demonstrate significant convergence rate improvement of our algorithm relative to the existing subgradient methods based on dual decomposition.
In this paper, we introduce a novel first-order dual gradient algorithm for solving network utility maximization problems that arise in resource allocation schemes over networks with safety-critical constraints. Inspired by applications where customers' demand can only be affected through posted prices and real-time two-way communication with customers is not available, we require an algorithm to generate \textit{safe prices}. This means that at no iteration should the realized demand in response to the posted prices violate the safety constraints of the network. Thus, in contrast to existing …
Stability of the utility maximization problem with random endowment and indifference prices is studied for a sequence of financial markets in an incomplete Brownian setting. Our novelty lies in the nonequivalence of markets, in which the volatility of asset prices (as well as the drift) varies. Degeneracies arise from the presence of nonequivalence. In the positive real line utility framework, a counterexample is presented showing that the expected utility maximization problem can be unstable. A positive stability result is proven for utility functions on the entire real line.
We give a general formulation of the utility maximization problem under nondominated model uncertainty in discrete time and show that an optimal portfolio exists for any utility function that is bounded from above. In the unbounded case, integrability conditions are needed as nonexistence may arise even if the value function is finite.
We study a robust utility maximization problem in the unbounded case with a general penalty term and information including jumps. We focus on time consistent penalties and we prove that there exists an optimal probability measure solution of the robust problem. Then, we characterize the dynamic value process of our stochastic control problem as the unique solution of a Quadratic-Exponential BSDE.
We establish the existence and characterization of a primal and a dual facelift - discontinuity of the value function at the terminal time - for utility-maximization in incomplete semimartingale-driven financial markets. Unlike in the lower- and upper-hedging problems, and somewhat unexpectedly, a facelift turns out to exist in utility-maximization despite strict convexity in the objective function. In addition to discussing our results in their natural, Markovian environment, we also use them to show that the dual optimizer cannot be found in the set of countably-additive (martingale) measure…
The effectiveness of utility-maximization techniques for portfolio management relies on our ability to estimate correctly the parameters of the dynamics of the underlying financial assets. In the setting of complete or incomplete financial markets, we investigate whether small perturbations of the market coefficient processes lead to small changes in the agent's optimal behavior derived from the solution of the related utility-maximization problems. Specifically, we identify the topologies on the parameter process space and the solution space under which utility-maximization is a continuous op…
We adress the maximization problem of expected utility from terminal wealth. The special feature of this paper is that we consider a financial market where the price process of risky assets can have a default time. Using dynamic programming, we characterize the value function with a backward stochastic differential equation and the optimal portfolio policies. We separately treat the cases of exponential, power and logarithmic utility.
We give explicit solutions for utility maximization of terminal wealth problem $u(X_T)$ in the presence of Knightian uncertainty in continuous time $[0,T]$ in a complete market. We assume there is uncertainty on both drift and volatility of the underlying stocks, which induce nonequivalent measures on canonical space of continuous paths $Ø$. We take that the uncertainty set resides in compact sets that are time dependent. In this framework, we solve the robust optimization problem with logarithmic, power and exponential utility functions, explicitly.
This article studies the sensitivity of the power utility maximization problem with respect to the investor's relative risk aversion, the statistical probability measure, the investment constraints and the market price of risk. We extend previous descriptions of the dual domain then exploit the link between the constrained utility maximization problem and continuous semimartingale quadratic BSDEs to reduce questions on sensitivity to results on stability for such equations. This then allows us to prove appropriate convergence of the primal and dual optimizers in the semimartingale topology.
We consider the problem of maximizing expected utility from terminal wealth in models with stochastic factors. Using martingale methods and a conditioning argument, we determine the optimal strategy for power utility under the assumption that the increments of the asset price are independent conditionally on the factor process.
This paper concerns the recursive utility maximization problem under partial information. We first transform our problem under partial information into the one under full information. When the generator of the recursive utility is concave, we adopt the variational formulation of the recursive utility which leads to a stochastic game problem and a characterization of the saddle point of the game is obtained. Then, we study the K-ignorance case and explicit saddle points of several examples are obtained. At last, when the generator of the recursive utility is smooth, we employ the terminal pertu…
We perform a stability analysis for the utility maximization problem in a general semimartingale model where both liquid and illiquid assets (random endowments) are present. Small misspecifications of preferences (as modeled via expected utility), as well as views of the world or the market model (as modeled via subjective probabilities) are considered. Simple sufficient conditions are given for the problem to be well-posed, in the sense the optimal wealth and the marginal utility-based prices are continuous functionals of preferences and probabilistic views.
We study power utility maximization for exponential Lévy models with portfolio constraints, where utility is obtained from consumption and/or terminal wealth. For convex constraints, an explicit solution in terms of the Lévy triplet is constructed under minimal assumptions by solving the Bellman equation. We use a novel transformation of the model to avoid technical conditions. The consequences for q-optimal martingale measures are discussed as well as extensions to non-convex constraints.
In this paper we report further progress towards a complete theory of state-independent expected utility maximization with semimartingale price processes for arbitrary utility function. Without any technical assumptions we establish a surprising Fenchel duality result on conjugate Orlicz spaces, offering a new economic insight into the nature of primal optima and providing fresh perspective on the classical papers of Kramkov and Schachermayer (1999, 2003). The analysis points to an intriguing interplay between no-arbitrage conditions and standard convex optimization and motivates study of the …
We consider the robust exponential utility maximization problem in discrete time: An investor maximizes the worst case expected exponential utility with respect to a family of nondominated probabilistic models of her endowment by dynamically investing in a financial market, and statically in available options. We show that, for any measurable random endowment (regardless of whether the problem is finite or not) an optimal strategy exists, a dual representation in terms of (calibrated) martingale measures holds true, and that the problem satisfies the dynamic programming principle (in case of n…
We consider a utility maximization problem for an investment-consumption portfolio when the current utility depends also on the wealth process. Such kind of problems arise, e.g., in portfolio optimization with random horizon or with random trading times. To overcome the difficulties of the problem we use the dual approach. We define a dual problem and treat it by means of dynamic programming, showing that the viscosity solutions of the associated Hamilton-Jacobi-Bellman equation belong to a suitable class of smooth functions. This allows to define a smooth solution of the primal Hamilton-Jacob…
We study the convex duality method for robust utility maximization in the presence of a random endowment. When the underlying price process is a locally bounded semimartingale, we show that the fundamental duality relation holds true for a wide class of utility functions on the whole real line and unbounded random endowment. To obtain this duality, we prove a robust version of Rockafellar's theorem on convex integral functionals and apply Fenchel's general duality theorem.
We study a network utility maximization (NUM) decomposition in which the set of flow rates is grouped by source-destination pairs. We develop theorems for both single-path and multipath cases, which relate an arbitrary NUM problem involving all flow rates to a simpler problem involving only the aggregate rates for each source-destination pair. The optimal aggregate flows are then apportioned among the constituent flows of each pair. This apportionment is simple for the case of $α$-fair utility functions. We also show how the decomposition can be implemented with the alternating direction metho…
In this paper, we study the dual problem of the expected utility maximization in incomplete markets with bounded random endowment. We start with the problem formulated in the paper of Cvitanić-Schachermayer-Wang (2001) and prove the following statement: in the Brownian framework, the countably additive part $Q^r$ of the dual optimizer $Q\in (L^\infty)^*$ obtained in that paper can be represented by the terminal value of a supermartingale deflator $Y$ defined in the paper of Kramkov-Schachermayer (1999), which is a local martingale.
We study utility maximization problem for general utility functions using dynamic programming approach. We consider an incomplete financial market model, where the dynamics of asset prices are described by an $R^d$-valued continuous semimartingale. Under some regularity assumptions we derive backward stochastic partial differential equation (BSPDE) related directly to the primal problem and show that the strategy is optimal if and only if the corresponding wealth process satisfies a certain forward-SDE. As examples the cases of power, exponential and logarithmic utilities are considered.
We study the sensitivity of the expected utility maximization problem in a continuous semi-martingale market with respect to small changes in the market price of risk. Assuming that the preferences of a rational economic agent are modeled with a general utility function, we obtain a second-order expansion of the value function, a first-order approximation of the terminal wealth, and construct trading strategies that match the indirect utility function up to the second order. If a risk-tolerance wealth process exists, using it as a numéraire and under an appropriate change of measure, we reduce…
We introduce a linear space of finitely additive measures to treat the problem of optimal expected utility from consumption under a stochastic clock and an unbounded random endowment process. In this way we establish existence and uniqueness for a large class of utility maximization problems including the classical ones of terminal wealth or consumption, as well as the problems depending on a random time-horizon or multiple consumption instances. As an example we treat explicitly the problem of maximizing the logarithmic utility of a consumption stream, where the local time of an Ornstein-Uhle…
In this paper we find tight sufficient conditions for the continuity of the value of the utility maximization problem from terminal wealth with respect to the convergence in distribution of the underlying processes. We also establish a weak convergence result for the terminal wealths of the optimal portfolios. Finally, we apply our results to the computation of the minimal expected shortfall (shortfall risk) in the Heston model by building an appropriate lattice approximation.
This paper investigates the problem of maximizing expected terminal utility in a (generically incomplete) discrete-time financial market model with finite time horizon. In contrast to the standard setting, a possibly non-concave utility function $U$ is considered, with domain of definition $\mathbb{R}$. Simple conditions are presented which guarantee the existence of an optimal strategy for the problem. In particular, the asymptotic elasticity of $U$ plays a decisive role: existence can be shown when it is strictly greater at $-\infty$ than at $+\infty$.
We consider the Network Utility Maximization (NUM) problem for wireless networks in the presence of arbitrary types of flows, including unicast, broadcast, multicast, and anycast traffic. Building upon the recent framework of a universal control policy (UMW), we design a utility optimal cross-layer admission control, routing and scheduling policy, called UMW+. The UMW+ policy takes packet level actions based on a precedence-relaxed virtual network. Using Lyapunov optimization techniques, we show that UMW+ maximizes network utility, while simultaneously keeping the physical queues in the networ…
Network utility maximization is the most important problem in network traffic management. Given the growth of modern communication networks, we consider the utility maximization problem in a network with a large number of connections (links) that are used by a huge number of users. To solve this problem an adaptive mirror descent algorithm for many constraints is proposed. The key feature of the algorithm is that it has a dimension-free convergence rate. The convergence of the proposed scheme is proved theoretically. The theoretical analysis is verified with numerical simulations. We compare t…
We study a robust portfolio optimization problem under model uncertainty for an investor with logarithmic or power utility. The uncertainty is specified by a set of possible Lévy triplets; that is, possible instantaneous drift, volatility and jump characteristics of the price process. We show that an optimal investment strategy exists and compute it in semi-closed form. Moreover, we provide a saddle point analysis describing a worst-case model.
In this paper we extend the stability results of [4]}. Our utility maximization problem is defined as an essential supremum of conditional expectations of the terminal values of wealth processes, conditioned on the filtration at the stopping time $τ$. To establish our results, we extend the classical results of convex analysis to maps from $L^0$ to $L^0$. The notion of convex compactness introduced in [7] plays an important role in our analysis.
We study a robust stochastic optimization problem in the quasi-sure setting in discrete-time. We show that under a lineality-type condition the problem admits a maximizer. This condition is implied by the no-arbitrage condition in models of financial markets. As a corollary, we obtain existence of an utility maximizer in the frictionless market model, markets with proportional transaction costs and also more general convex costs, like in the case of market impact.
We consider a utility maximization problem over partially observable Markov ON/OFF channels. In this network instantaneous channel states are never known, and at most one user is selected for service in every slot according to the partial channel information provided by past observations. Solving the utility maximization problem directly is difficult because it involves solving partially observable Markov decision processes. Instead, we construct an approximate solution by optimizing the network utility only over a good constrained network capacity region rendered by stationary policies. Using…
We consider the economic problem of optimal consumption and investment with power utility. We study the optimal strategy as the relative risk aversion tends to infinity or to one. The convergence of the optimal consumption is obtained for general semimartingale models while the convergence of the optimal trading strategy is obtained for continuous models. The limits are related to exponential and logarithmic utility. To derive these results, we combine approaches from optimal control, convex analysis and backward stochastic differential equations (BSDEs).
In this paper, we study expected utility maximization under ratchet and drawdown constraints on consumption in a general incomplete semimartingale market using duality methods. The optimization is considered with respect to two parameters: the initial wealth and the essential lower bound on consumption process. In order to state the problem and define the primal domains, we introduce a natural extension of the notion of running maximum to arbitrary non-negative optional processes and study its properties. The dual domains for optimization are characterized in terms of solidity with respect to …
We consider a discrete time financial market with proportional transaction costs under model uncertainty, and study a numéraire-based semi-static utility maximization problem with an exponential utility preference. The randomization techniques recently developed in \cite{BDT17} allow us to transform the original problem into a frictionless counterpart on an enlarged space. By suggesting a different dynamic programming argument than in \cite{bartl2016exponential}, we are able to prove the existence of the optimal strategy and the convex duality theorem in our context with transaction costs. In …
We present an optimal investment theorem for a currency exchange model with random and possibly discontinuous proportional transaction costs. The investor's preferences are represented by a multivariate utility function, allowing for simultaneous consumption of any prescribed selection of the currencies at a given terminal date. We prove the existence of an optimal portfolio process under the assumption of asymptotic satiability of the value function. Sufficient conditions for asymptotic satiability of the value function include reasonable asymptotic elasticity of the utility function, or a gr…
This paper studies the problem of optimal investment in incomplete markets, robust with respect to stopping times. We work on a Brownian motion framework and the stopping times are adapted to the Brownian filtration. Robustness can only be achieved for logartihmic utility, otherwise a cashflow should be added to the investor s wealth. The cashflow can be decomposed into the sum of an increasing and a decreasing process. The last one can be viewed as consumption. The first one is an insurance premium the agent has to pay.
This paper discusses the numéraire-based utility maximization problem in markets with proportional transaction costs. In particular, the investor is required to liquidate all her position in stock at the terminal time. We first observe the stability of the primal and dual value functions as well as the convergence of the primal and dual optimizers when perturbations occur on the utility function and on the physical probability. We then study the properties of the optimal dual process (ODP), that is, a process from the dual domain that induces the optimality of the dual problem. When the market…
This paper addresses the problem of utility maximization under uncertain parameters. In contrast with the classical approach, where the parameters of the model evolve freely within a given range, we constrain them via a penalty function. We show that this robust optimization process can be interpreted as a two-player zero-sum stochastic differential game. We prove that the value function satisfies the Dynamic Programming Principle and that it is the unique viscosity solution of an associated Hamilton-Jacobi-Bellman-Isaacs equation. We test this robust algorithm on real market data. The results…
University at Buffalo（纽约州立大学布法罗分校）；University of Michigan, Ann Arbor（密歇根大学安娜堡分校）
Fair resource allocation is one of the most important topics in communication networks. Existing solutions almost exclusively assume each user utility function is known and concave. This paper seeks to answer the following question: how to allocate resources when utility functions are unknown, even to the users? This answer has become increasingly important in the next-generation AI-aware communication networks where the user utilities are complex and their closed-forms are hard to obtain. In this paper, we provide a new solution using a distributed and data-driven bilevel optimization approac…
We formulate conditions for the solvability of the problem of robust utility maximization from final wealth in continuous time financial markets, without assuming weak compactness of the densities of the uncertainty set, as customary in the literature. Relevant examples of such a situation typically arise when the uncertainty set is determined through moment constraints. Our approach is based on identifying functional spaces naturally associated with the elements of each problem. For general markets these are modular spaces, through which we can prove a minimax equality and the existence of op…
We consider a utility-maximization problem in a general semimartingale financial model, subject to constraints on the number of shares held in each risky asset. These constraints are modeled by predictable convex-set-valued processes whose values do not necessarily contain the origin; that is, it may be inadmissible for an investor to hold no risky investment at all. Such a setup subsumes the classical constrained utility-maximization problem, as well as the problem where illiquid assets or a random endowment are present. Our main result establishes the existence of optimal trading strategies …
This paper investigates the asymptotic and non-asymptotic behavior of the quantized primal dual algorithm in network utility maximization problems, in which a group of agents maximize the sum of their individual concave objective functions under linear constraints. In the asymptotic scenario, we use the information theoretic notion of differential entropy power to establish universal lower bounds on the exponential convergence rates of joint primal dual, primal and dual variables under optimum achieving quantization schemes. These results provide trade offs between the speed of exponential con…
This paper studies the continuous time utility maximization problem on consumption with addictive habit formation in incomplete semimartingale markets. Introducing the set of auxiliary state processes and the modified dual space, we embed our original problem into a time-separable utility maximization problem with a shadow random endowment on the product space $\mathbb{L}_+^0(Ω\times [0,T],\mathcal{O},\overline{\mathbb{P}})$. Existence and uniqueness of the optimal solution are established using convex duality approach, where the primal value function is defined on two variables, that is, the …
Using elementary arguments, we show how to derive $\mathbf{L}_p$-error bounds for the approximation of frictionless wealth process in markets with proportional transaction costs. For utilities with bounded risk aversion, these estimates yield lower bounds for the frictional value function, which pave the way for its asymptotic analysis using stability results for viscosity solutions. Using tools from Malliavin calculus, we also derive simple sufficient conditions for the regularity of frictionless optimal trading strategies, the second main ingredient for the asymptotic analysis of small trans…
This paper studies the utility maximization problem of an agent with non-trivial endowment, and whose preferences are modeled by the maximal subsolution of a BSDE. We prove existence of an optimal trading strategy and relate our existence result to the existence of a maximal subsolution to a controlled decoupled FBSDE. Using BSDE duality, we show that the utility maximization problem can be seen as a robust control problem admitting a saddle point if the generator of the BSDE additionally satisfies a specific growth condition. We show by convex duality that any saddle point of the robust contr…
We present a solution of a class of network utility maximization (NUM) problems using minimal communication. The constraints of the problem are inspired less by TCP-like congestion control but by problems in the area of internet of things and related areas in which the need arises to bring the behavior of a large group of agents to a social optimum. The approach uses only intermittent feedback, no inter-agent communication, and no common clock. The proposed algorithm is a combination of the classical AIMD algorithm in conjunction with a simple probabilistic rule for the agents to respond to a …
The network utility maximization problem (NUM) for multi-path is a problem which is non-strictly convex and non-separable. Using Jensen's inequality, we approximate the NUM to a strictly convex and separable problem which can be solved efficiently by the dual decomposition method. After a series of approximations, the result of the approximation problem converges to the globally optimal solution of the original problem. Moreover, because of the separable and dual-based natures of the proposed algorithm, we utilize the reverse engineering frameworks of the current TCPs to develop a series of mu…
We examine the issue of sensitivity with respect to model parameters for the problem of utility maximization from final wealth in an incomplete Samuelson model and mainly, but not exclusively, for utility functions of positive power-type. The method consists in moving the parameters through change of measure, which we call a weak perturbation, decoupling the usual wealth equation from the varying parameters. By rewriting the maximization problem in terms of a convex-analytical support function of a weakly-compact set, crucially leveraging on the work of Backhoff and Fontbona (SIFIN 2016), the …
In an incomplete model, where under an appropriate numéraire, the stock price process is driven by a sigma-bounded semimartingale, we investigate the behavior of the expected utility maximization problem under small perturbations of the numéraire. We establish a quadratic approximation of the value function and a first-order expansion of the terminal wealth. Relying on a description of the base return process in terms of its semimartingale characteristics, we also construct wealth processes and nearly optimal strategies that allow for matching the primal value function up to the second order. …
We study the problem of utility maximization from terminal wealth in which an agent optimally builds her portfolio by investing in a bond and a risky asset. The asset price dynamics follow a diffusion process with regime-switching coefficients modeled by a continuous-time finite-state Markov chain. We consider an investor with a Constant Relative Risk Aversion (CRRA) utility function. We deduce the associated Hamilton-Jacobi-Bellman equation to construct the solution and the optimal trading strategy and verify optimality by showing that the value function is the unique constrained viscosity so…
