A known property of conditional expectation is extended to the framework of Markov kernels. Its meaning in terms of densities is provided. Some examples located in the field of clinical diagnosis are presented to delimit the main result of the paper.
We characterize the properties of convexity, compactness and preservation of upper hemicontinuity for conditional expectations of correspondences. These results are then applied to obtain a necessary and sufficient condition for the existence of pure strategy equilibria in Bayesian games.
Generalized conditional expectations, optional projections and predictable projections of stochastic processes play important roles in the general theory of stochastic processes, semimartingale theory and stochastic calculus. They share some important properties with ordinary conditional expectations. While the characterization of ordinary conditional expectations has been studied by several authors, no similar work seems to have been done for these three concepts. This paper aims at undertaking this task by giving And$\hat{o}$-Douglas type characterization theorem for each of them.
We prove that the exponential distribution is the only one which satisfies a regression identity. This identity involves conditional expectation of the sample mean of record values given two record values outside of the sample.
We derive upper bounds on the tail conditional expectation of binomial and Poisson random variables. Those upper bounds are subsequently employed to the problem of obtaining non-asymptotic lower bounds on the probability that the aforementioned random variables are significantly larger than their expectation.
In this paper, we define a dynamically consistent conditional G-expectation in space $\mathbb{L}^{p}$, and give the related stochastic calculus of Itô's type, especially get Itô's formula for a general $C^{1,2}$-function.
In this paper we extend the definition of time conditional G-expectations $\mathbb{\hat{E}}_{t}[\cdot]$ to a larger domain on which the dynamical consistency still holds. In fact we can consistently define, by taking the limit, the time conditional expectations for each random variable $X$ which is the downward limit (resp. upward limit) of a monotone sequence $\{X_{i}\}$ in $L_{G}^{1}(Ω)$. To accomplish this procedure, some careful analysis is needed. Moreover, we give a suitable definition of stopping times and obtain the optional stopping theorem. We also provide some basic and interesting …
In this paper we continue the study of conditional Markov chains (CMCs) with finite state spaces, that we initiated in Bielecki, Jakubowski and Niewęgłowski (2015). Here, we turn our attention to the study of Markov consistency and Markov copulae with regard to CMCs, and thus we follow up on the study of Markov consistency and Markov copulae for ordinary Markov chains that we presented in Bielecki, Jakubowski and Niewęgłowski (2013).
In this paper, we investigate the convergence of products of conditional expectation operators. We show that if $(Ω,\cal{F},P)$ is a probability space that is not purely atomic, then divergent sequences of products of conditional expectation operators involving 3 or 4 sub-$σ$-fields of $\cal{F}$ can be constructed for a large class of random variables in $L^2(Ω,\cal{F},P)$. This settles in the negative a long-open conjecture. On the other hand, we show that if $(Ω,\cal{F},P)$ is a purely atomic probability space, then products of conditional expectation operators involving any finite set of su…
We present some regularity properties (convexity, weak/weak* compactness and preservation of weak/weak* upper hemicontinuity) for Bochner/Gelfand conditional expectation of Banach valued correspondences under the nowhere equivalence condition. These regularity properties for Bochner/Gelfand integral of Banach valued correspondences are obtained as corollaries. Similar properties for regular conditional distributions are also covered by the corresponding results for Gelfand conditional expectation of correspondences. We prove the necessity of the nowhere equivalence condition for any of these p…
We investigate a possible definition of expectation and conditional expectation for random variables with values in a local field such as the $p$-adic numbers. We define the expectation by analogy with the observation that for real-valued random variables in $L^2$ the expected value is the orthogonal projection onto the constants. Previous work has shown that the local field version of $L^\infty$ is the appropriate counterpart of $L^2$, and so the expected value of a local field-valued random variable is defined to be its ``projection'' in $L^\infty$ onto the constants. Unlike the real case, t…
We give a variational formulation for $-\log\mathbb{E}_ν\left[e^{-f}|\mathcal{F}_t\right]$ for a large class of measures $ν$. We give a refined entropic characterization of the invertibility of some perturbations of the identity. We also discuss the attainability of the infimum in the variational formulation and obtain a Prékopa-Leindler theorem for conditional expectations.
This paper deals with rates of convergence in the strong law of large numbers, in the Baum-Katz form, for partial sums of Banach space valued random variables. The results are then applied to solve similar problems for weighted partial sums of conditional expectations. They are further used to treat partial sums of powers of a reversible Markov chain operator. The method of proof is based on martingale approximation. The conditions are expressed in terms moments of the individual summands.
We represent fractional conditional expectations of a functional of fractional Brownian motion as a convergent series in L^2 space. When the target random variable is some function of a discrete trajectory of fractional Brownian motion, we obtain a backward Taylor series representation; when the target functional is generated by a continuous fractional filtration, the series representation is obtained by applying a "frozen path" operator and an exponential operator to the functional. Three examples are provided to show that our representation gives useful series expansions of ordinary expectat…
We derive two conditional expectation bounds, which we use to simplify cryptographic security proofs. The first bound relates the expectation of a bounded random variable and the average of its conditional expectations with respect to a set of i.i.d. random objects. It shows, under certain conditions, that the conditional expectation average has a small tail probability when the expectation of the random variable is sufficiently large. It is used to simplify the proof that the existence of weakly one-way functions implies the existence of strongly one-way functions. The second bound relaxes th…
We present a numerical method to compute expectations of functionals of a piecewise-deterministic Markov process. We discuss time dependent functionals as well as deterministic time horizon problems. Our approach is based on the quantization of an underlying discrete-time Markov chain. We obtain bounds for the rate of convergence of the algorithm. The approximation we propose is easily computable and is flexible with respect to some of the parameters defining the problem. Two examples illustrate the paper.
We study the quasi-stationary behavior of multidimensional processes absorbed when one of the coordinates vanishes. Our results cover competitive or weakly cooperative Lotka-Volterra birth and death processes and Feller diffusions with competitive Lotka-Volterra interaction. To this aim, we develop original non-linear Lyapunov criteria involving two Lyapunov functions, which apply to general Markov processes.
When a mathematical or computational model is used to analyse some system, it is usual that some parameters resp.\ functions or fields in the model are not known, and hence uncertain. These parametric quantities are then identified by actual observations of the response of the real system. In a probabilistic setting, Bayes's theory is the proper mathematical background for this identification process. The possibility of being able to compute a conditional expectation turns out to be crucial for this purpose. We show how this theoretical background can be used in an actual numerical procedure, …
In this paper we continue the study of conditional Markov chains (CMCs) with finite state spaces, that we initiated in Bielecki, Jakubowski and Niewęgłowski (2014a) in an effort to enrich the theory of CMCs that was originated in Bielecki and Rutkowski (2004). We provide an alternative definition of a CMC and an alternative construction of a CMC via a change of probability measure. It turns out that our construction produces CMCs that are also doubly stochastic Markov chains (DSMCs), which allows for study of several properties of CMCs using tools available for DSMCs.
In this paper, we consider continuous-time Markov chains with a finite state space under nonlinear expectations. We define so-called Q-operators as an extension of Q-matrices or rate matrices to a nonlinear setup, where the nonlinearity is due to model uncertainty. The main result gives a full characterization of convex Q-operators in terms of a positive maximum principle, a dual representation by means of Q-matrices, continuous-time Markov chains under convex expectations and nonlinear ordinary differential equations. This extends a classical characterization of generators of Markov chains to…
In this paper it is shown that adaptive importance sampling algorithms converge at exponential rate for Markov chain expectation problems that admit a combination of a filtered estimator and a Markov zero-variance measure. It extends a chain of results---special purpose proofs were already known for several cases (Kollman et al, Baggerly et al, Desai). A recent paper (Awad et al) provides a complete description of the class of combinations of Markov process expectations of path functionals and filtered estimators that admit zero-variance importance measures that retain the Markov property. In …
We justify and discuss expressions for joint lower and upper expectations in imprecise probability trees, in terms of the sub- and supermartingales that can be associated with such trees. These imprecise probability trees can be seen as discrete-time stochastic processes with finite state sets and transition probabilities that are imprecise, in the sense that they are only known to belong to some convex closed set of probability measures. We derive various properties for their joint lower and upper expectations, and in particular a law of iterated expectations. We then focus on the special cas…
It is often of interest to condition on a singular event given by a random variable, e.g. $\{Y=y\}$ for a continuous random variable $Y$. Conditional measures with respect to this event are usually derived as a special case of the conditional expectation with respect to the random variables generating sigma algebra. The existence of the latter is usually proven via a non-constructive measure-theoretic argument which yields an only almost-everywhere defined quantity. In particular, the quantity $\mathbb E[f|Y]$ is initially only defined almost everywhere and conditioning on $Y=y$ corresponds to…
We consider the problem of performing inference with imprecise continuous-time hidden Markov chains, that is, imprecise continuous-time Markov chains that are augmented with random output variables whose distribution depends on the hidden state of the chain. The prefix `imprecise' refers to the fact that we do not consider a classical continuous-time Markov chain, but replace it with a robust extension that allows us to represent various types of model uncertainty, using the theory of imprecise probabilities. The inference problem amounts to computing lower expectations of functions on the sta…
We consider a family of Markov chains whose transition dynamics are affected by model parameters. Understanding the parametric dependence of (complex) performance measures of such Markov chains is often of significant interest. The derivatives of the performance measures w.r.t. the parameters play important roles, for example, in numerical optimization of the performance measures, and quantification of the uncertainties in the performance measures when there are uncertainties in the parameters from the statistical estimation procedures. In this paper, we establish conditions that guarantee the…
An efficient discrete time and space Markov chain approximation employing a Brownian bridge correction for computing curvilinear boundary crossing probabilities for general diffusion processes was recently proposed in Liang and Borovkov (2021). One of the advantages of that method over alternative approaches is that it can be readily extended to computing expectations of path-dependent functionals over the event of the process trajectory staying between two curvilinear boundaries. In the present paper, we extend the scheme to compute expectations of the Feynman--Kac type that frequently appear…
The main subject of the study in this paper is the simultaneous renewal time for two time-inhomogeneous Markov chains which start with arbitrary initial distributions. By a simultaneous renewal we mean the first time of joint hitting the specific set $C$ by both processes. Under the condition of existence a dominating sequence for both renewal sequences generated by the chains and non-lattice condition for renewal probabilities an upper bound for the expectation of the simultaneous renewal time is obtained.
In this paper, we consider two time-inhomogeneous Markov chains $X^{(l)}_t$, $l\in\{1,2\}$, with discrete time on a general state space. We assume the existence of some renewal set $C$ and investigate the time of simultaneous renewal, that is, the first positive time when the chains hit the set $C$ simultaneously. The initial distributions for both chains may be arbitrary. Under the condition of stochastic domination and nonlattice condition for both renewal processes, we derive an upper bound for the expectation of the simultaneous renewal time. Such a bound was calculated for two time-inhomo…
In this paper, we introduce the concept of hyperbolic valued random variables, their expectation and moments. We develop the hyperbolic analogue of Binomial and Poisson distributions. We study some of the properties of expectation on the basis of decomposition of a hyperbolic number into idempotent components. Finally we define conditional expectation of hyperbolic valued random variable and study some of its basic properties. Our random variable can take values which are zero divisors and this is the important part of this study.
A necessary and sufficient condition on a sequence $\{\mathfrak{A}_n\}_{n\in \mathbb{N}}$ of $σ$-subalgebras that assures convergence almost every where of conditional expectations is given.
We study properties of a subclass of Markov processes that have all moments that are continuous functions of the time parameter and more importantly are characterized by the property that say their $n-$th conditional moment given the past is also a polynomial of degree not exceeding $n.$ Of course all processes with independent increments with all moments belong to this class. We give characterization of them within the studied class. We indicate other examples of such process. Besides we indicate families of polynomials that have the property of constituting martingales. We also study conditi…
After a brief introduction to Probability Bracket Notation (PBN), indicator operator and conditional density operator (CDO), we investigate probability spaces associated with various quantum systems: system with one observable (discrete or continuous), system with two commutative observables (independent or dependent) and a system of indistinguishable non-interacting many-particles. In each case, we derive unified expressions of conditional expectation (CE), conditional probability (CP), and absolute probability (AP): they have the same format for discrete or continuous spectrum; they are defi…
Let $(X_1,\dots,X_m)$ be self-adjoint non-commutative random variables distributed according to the free Gibbs law given by a sufficiently regular convex and semi-concave potential $V$, and let $(S_1,\dots,S_m)$ be a free semicircular family. We show that conditional expectations and conditional non-microstates free entropy given $X_1$, \dots, $X_k$ arise as the large $N$ limit of the corresponding conditional expectations and entropy for the random matrix models associated to $V$. Then by studying conditional transport of measure for the matrix models, we construct an isomorphism $\mathrm{W}^…
A non-Euclidean generalization of conditional expectation is introduced and characterized as the minimizer of expected intrinsic squared-distance from a manifold-valued target. The computational tractable formulation expresses the non-convex optimization problem as transformations of Euclidean conditional expectation. This gives computationally tractable filtering equations for the dynamics of the intrinsic conditional expectation of a manifold-valued signal and is used to obtain accurate numerical forecasts of efficient portfolios by incorporating their geometric structure into the estimates.
Let $(A,\mathscr{A},μ)$ and $(B,\mathscr{B},ν)$ be probability spaces, let $\mathscr{F}$ be a sub-$σ$-algebra of the product $σ$-algebra $\mathscr{A}\times\mathscr{B}$, let $X$ be a Banach space, and let $1< p,q< \infty$. We obtain necessary and sufficient conditions in order that the conditional expectation with respect to $\mathscr{F}$ defines a bounded linear operator from $L^p(μ;L^q(ν;X))$ onto $L^p_{\mathscr{F}}(μ;L^q(ν;X))$, the closed subspace in $L^p(μ;L^q(ν;X))$ of all functions having a strongly $\mathscr{F}$-measurable representative.
For a linear combination of random variables, fix some confidence level and consider the quantile of the combination at this level. We are interested in the partial derivatives of the quantile with respect to the weights of the random variables in the combination. It turns out that under suitable conditions on the joint distribution of the random variables the derivatives exist and coincide with the conditional expectations of the variables given that their combination just equals the quantile. Moreover, using this result, we deduce formulas for the derivatives with respect to the weights of t…
We study the conditional distribution of zeros of a Gaussian system of random polynomials (and more generally, holomorphic sections), given that the polynomials or sections vanish at a point p (or a fixed finite set of points). The conditional distribution is analogous to the pair correlation function of zeros, but we show that it has quite a different small distance behavior. In particular, the conditional distribution does not exhibit repulsion of zeros in dimension one. To prove this, we give universal scaling asymptotics for the conditional zero distribution around p. The key tool is the c…
Consider a pair of random vectors $(\mathbf{X},\mathbf{Y}) $ and the conditional expectation operator $\mathbb{E}[\mathbf{X}|\mathbf{Y}=\mathbf{y}]$. This work studies analytic properties of the conditional expectation by characterizing various derivative identities. The paper consists of two parts. In the first part of the paper, a general derivative identity for the conditional expectation is derived. Specifically, for the Markov chain $\mathbf{U} \leftrightarrow \mathbf{X} \leftrightarrow \mathbf{Y}$, a compact expression for the Jacobian matrix of $\mathbb{E}[\mathbf{U}|\mathbf{Y}=\mathbf{…
We consider a discrete time hidden Markov model where the signal is a stationary Markov chain. When conditioned on the observations, the signal is a Markov chain in a random environment under the conditional measure. It is shown that this conditional signal is weakly ergodic when the signal is ergodic and the observations are nondegenerate. This permits a delicate exchange of the intersection and supremum of $σ$-fields, which is key for the stability of the nonlinear filter and partially resolves a long-standing gap in the proof of a result of Kunita [J. Multivariate Anal. 1 (1971) 365--393]. …
In this paper, we derive a representation for the value process associated to the solutions of FBSDEs in a jump-diffusion setting under multiple probability measures. Motivated by concrete financial problems, the latter representations are then applied to devise a generalization of the change of numéraire technique allowing to obtain recursive pricing formulas in the presence of multiple interest rates and collateralization.
The pricing of Bermudan options amounts to solving a dynamic programming principle, in which the main difficulty, especially in high dimension, comes from the conditional expectation involved in the computation of the continuation value. These conditional expectations are classically computed by regression techniques on a finite dimensional vector space. In this work, we study neural networks approximations of conditional expectations. We prove the convergence of the well-known Longstaff and Schwartz algorithm when the standard least-square regression is replaced by a neural network approximat…
This paper deals with multidimensional dynamic risk measures induced by conditional $g$-expectations. A notion of multidimensional $g$-expectation is proposed to provide a multidimensional version of nonlinear expectations. By a technical result on explicit expressions for the comparison theorem, uniqueness theorem and viability on a rectangle of solutions to multidimensional backward stochastic differential equations, some necessary and sufficient conditions are given for the constancy, monotonicity, positivity, homogeneity and translatability properties of multidimensional conditional $g$-ex…
We consider coherent sublinear expectations on a measurable space, without assuming the existence of a dominating probability measure. By considering a decomposition of the space in terms of the supports of the measures representing our sublinear expectation, we give a simple construction, in a quasi-sure sense, of the (linear) conditional expectations, and hence give a representation for the conditional sublinear expectation. We also show an aggregation property holds, and give an equivalence between consistency and a pasting property of measures.
We consider a channel $Y=X+N$ where $X$ is a random variable satisfying $\mathbb{E}[|X|]<\infty$ and $N$ is an independent standard normal random variable. We show that the minimum mean-square error estimator of $X$ from $Y,$ which is given by the conditional expectation $\mathbb{E}[X \mid Y],$ is a polynomial in $Y$ if and only if it is linear or constant; these two cases correspond to $X$ being Gaussian or a constant, respectively. We also prove that the higher-order derivatives of $y \mapsto \mathbb{E}[X \mid Y=y]$ are expressible as multivariate polynomials in the functions $y \mapsto \mat…
Let {M_n}_{n\ge 0}$ be a nonnegative Markov process with stationary transition probabilities. The quasistationary distributions referred to in this note are of the form Q_A(x) = lim_{n\to\infty} P(M_n \le x | M_0 \le A, M_1 \le A, ..., M_n \le A) . Suppose that $M_0$ has distribution $\Qb_A$ and define T_A^{Q_A} = \min\{n | M_n > A, n\ge 1\}, the first time when M_n exceeds A. We provide sufficient conditions for E T_A^{Q_A}$ to be an increasing function of A.
In this paper we consider the convergence of the conditional entropy to the entropy rate for Markov chains. Convergence of certain statistics of long range dependent processes, such as the sample mean, is slow. It has been shown in Carpio and Daley \cite{carpio2007long} that the convergence of the $n$-step transition probabilities to the stationary distribution is slow, without quantifying the convergence rate. We prove that the slow convergence also applies to convergence to an information-theoretic measure, the entropy rate, by showing that the convergence rate is equivalent to the convergen…
We develop Markov categories as a framework for synthetic probability and statistics, following work of Golubtsov as well as Cho and Jacobs. This means that we treat the following concepts in purely abstract categorical terms: conditioning and disintegration; various versions of conditional independence and its standard properties; conditional products; almost surely; sufficient statistics; versions of theorems on sufficient statistics due to Fisher--Neyman, Basu, and Bahadur. Besides the conceptual clarity offered by our categorical setup, its main advantage is that it provides a uniform trea…