A new type of stochastic dependence for a sequence of random variables is introduced and studied. Precisely, (X_n)_{n\geq 1} is said to be conditionally identically distributed (c.i.d.), with respect to a filtration (G_n)_{n\geq 0}, if it is adapted to (G_n)_{n\geq 0} and, for each n\geq 0, (X_k)_{k>n} is identically distributed given the past G_n. In case G_0={\varnothing,Ω} and G_n=σ(X_1,...,X_n), a result of Kallenberg implies that (X_n)_{n\geq 1} is exchangeable if and only if it is stationary and c.i.d. After giving some natural examples of nonexchangeable c.i.d. sequences, it is shown that (X_n)_{n\geq 1} is exchangeable if and only if (X_{τ(n)})_{n\geq 1} is c.i.d. for any finite permutation τof {1,2,...}, and that the distribution of a c.i.d. sequence agrees with an exchangeable law on a certain sub-σ-field. Moreover, (1/n)\sum_{k=1}^nX_k converges a.s. and in L^1 whenever (X_n)_{n\geq 1} is (real-valued) c.i.d. and E[|
X_1| ]<\infty. As to the CLT, three types of random centering are considered. One such centering, significant in Bayesian prediction and discrete time filtering, is E[X_{n+1}| G_n]. For each centering, convergence in distribution of the corresponding empirical process is analyzed under uniform distance.
In this paper, joint limit distributions of maxima and minima on independent and non-identically distributed bivariate Gaussian triangular arrays is derived as the correlation coefficient of $i$th vector of given $n$th row is the function of $i/n$. Furthermore, second-order expansions of joint distributions of maxima and minima are established if the correlation function satisfies some regular conditions.
We consider random walks with independent but not necessarily identical distributed increments. Assuming that the increments satisfy the well-known Lindeberg condition, we investigate the asymptotic behaviour of first-passage times over moving boundaries. Furthermore, we prove that a properly rescaled random walk conditioned to stay above the boundary up to time $n$ converges, as $n\to\infty$, towards the Brownian meander.
Let $X,X_1,\ldots,X_n$ be independent identically distributed random variables. The paper deals with the question about the behavior of the concentration function of the random variable $\sum\limits_{k=1}^{n}X_k a_k$ according to the arithmetic structure of vectors $a_k$. Recently, the interest to this question has increased significantly due to the study of distributions of eigenvalues of random matrices. In this paper we formulate and prove multidimensional generalizations of the results Eliseeva and Zaitsev (2012). They are also the refinements of the results of Friedland and Sodin (2007) a…
We prove weak laws of large numbers and central limit theorems of Lindeberg type for empirical centres of mass (empirical Fréchet means) of independent non-identically distributed random variables taking values in Riemannian manifolds. In order to prove these theorems we describe and prove a simple kind of Lindeberg-Feller central approximation theorem for vector-valued random variables, which may be of independent interest and is therefore the subject of a self-contained section. This vector-valued result allows us to clarify the number of conditions required for the central limit theorem for…
Let X_1,X_2,... be a sequence of independent and identically distributed random variables, and put S_n=X_1+...+X_n. Under some conditions on the positive sequence tau_n and the positive increasing sequence a_n, we give necessary and sufficient conditions for the convergence of sum_{n=1}^infty tau_n P(|S_n|>t a_n) for all t>0, generalizing Baum and Katz's (1965) generalization of the Hsu-Robbins-Erdos (1947, 1949) law of large numbers, also allowing us to characterize the convergence of the above series in the case where tau_n=1/n and a_n=(n log n)^{1/2} for n>1, thereby answering a question of…
Let $X_1,X_2,...$ be a sequence of independent and identically distributed random variables, and put $S_n=X_1+...+X_n$. Under some conditions on the positive sequence $τ_n$ and the positive increasing sequence $a_n$, we give necessary and sufficient conditions for the convergence of $\sum_{n=1}^\infty τ_n P(|S_n|\ge εa_n)$ for all $ε>0$, generalizing Baum and Katz's (1965) generalization of the Hsu-Robbins-Erdos (1947, 1949) law of large numbers, also allowing us to characterize the convergence of the above series in the case where $τ_n=n^{-1}$ and $a_n=(n\log n)^{1/2}$ for $n\ge 2$, thereby a…
A notion of conditionally identically distributed (c.i.d.) sequences has been studied as a form of stochastic dependence that is weaker than exchangeability, but is equivalent to exchangeability for stationary sequences. In this article we extend this notion to families of sequences. Paralleling the extension from exchangeability to partial exchangeability in the sense of de Finetti, we propose a notion of partially c.i.d. dependence, that is equivalent to partial exchangeability for stationary processes. Partially c.i.d. families of sequences preserve attractive limit properties of partial ex…
We show first that there are intrinsic relationships among different conditions, old and recent, which lead to some general statements in both the Stieltjes and the Hamburger moment problems. Then we describe checkable conditions and prove new results about the moment (in)determinacy for products of independent and non-identically distributed random variables. We treat all three cases when the random variables are nonnegative (Stieltjes case), when they take values in the whole real line (Hamburger case), and the mixed case. As an illustration we characterize the moment determinacy of products…
On strong law of large numbers for non identically distributed random variables
M.V. Lomonosov Moscow State University（莫斯科国立罗蒙诺索夫大学）；Institute for Information Transmission Problems (A.A.Kharkevich Institute)（信息传输问题研究所（A.A.哈尔克维奇研究所））；RUDN University（俄罗斯人民友谊大学）；NRU HSE（高等经济国立大学）
This paper focuses on the size-biased permutation of $n$ independent and identically distributed (i.i.d.) positive random variables. This is a finite dimensional analogue of the size-biased permutation of ranked jumps of a subordinator studied in Perman-Pitman-Yor (PPY) [Probab. Theory Related Fields 92 (1992) 21-39], as well as a special form of induced order statistics [Bull. Inst. Internat. Statist. 45 (1973) 295-300; Ann. Statist. 2 (1974) 1034-1039]. This intersection grants us different tools for deriving distributional properties. Their comparisons lead to new results, as well as simple…
Let $X_1,X_2,...$ be independent identically distributed random variables with values in $\C$. Denote by $μ$ the probability distribution of $X_1$. Consider a random polynomial $P_n(z)=(z-X_1)...(z-X_n)$. We prove a conjecture of Pemantle and Rivin [arXiv:1109.5975] that the empirical measure $μ_n:=\frac 1{n-1}\sum_{P_n'(z)=0} δ_z$ counting the complex zeros of the derivative $P_n'$ converges in probability to $μ$, as $n\to\infty$.
By a modification of the method that was applied in (Korolev and Shevtsova, 2010), here the inequalities $Δ_n\leq0.3328(β_3+0.429)/\sqrt{n}$ and $Δ_n\leq0.33554(β_3+0.415)/\sqrt{n}$ are proved for the uniform distance $Δ_n$ between the standard normal distribution function and the distribution function of the normalized sum of an arbitrary number $n\geq1$ of independent identically distributed random variables with zero mean, unit variance and finite third absolute moment $β_3$. The first of these two inequalities improves one that was proved in (Korolev and Shevtsova, 2010), and as well sharp…
A completion of counterexamples to the classical central limit theorem for pair- and triplewise independent and identically distributed random variables
本文完善了经典中心极限定理的反例研究，证明对于任意具有有限方差且不集中于单点的概率分布，均存在三重独立同分布随机变量序列使其标准化部分和依分布收敛于非正态分布，并可推广至 $ k $ 重独立性。
We show that when $\set{X_j}$ is a sequence of independent (but not necessarily identically distributed) random variables which satisfies a condition similar to the Lindeberg condition, the properly normalized geometric sum $\sum_{j=1}^{ν_p}X_j$ (where $ν_p$ is a geometric random variable with mean $1/p$) converges in distribution to a Laplace distribution as $p\to 0$. The same conclusion holds for the multivariate case. This theorem provides a reason for the ubiquity of the double power law in economic and financial data.
Conditional identity in distribution (Berti et al. (2004)) is a new type of dependence for random variables, which generalizes the well-known notion of exchangeability. In this paper, a class of random sequences, called Generalized Species Sampling Sequences, is defined and a condition to have conditional identity in distribution is given. Moreover, a class of generalized species sampling sequences that are conditionally identically distributed is introduced and studied: the Generalized Ottawa sequences (GOS). This class contains a '`randomly reinforced'' version of the Pólya urn and of the Bl…
We consider the problem of finding the optimal upper bound for the tail probability of a sum of $k$ nonnegative, independent and identically distributed random variables with given mean $x$. For $k=1$ the answer is given by Markov's inequality and for $k=2$ the solution was found by Hoeffding and Shrikhande in 1955. We solve the problem for $k=3$ as well as for general $k$ and $x\leq1/(2k-1)$ by showing that it follows from the fractional version of an extremal graph theory problem of Erdős on matchings in hypergraphs.
We derive strong laws of large numbers and central limit theorems for Bajraktarević, Gini and exponential- (also called Beta-type) and logarithmic Cauchy quotient means of independent identically distributed (i.i.d.) random variables. The exponential- and logarithmic Cauchy quotient means of a sequence of i.i.d. random variables behave asymptotically normal with the usual square root scaling just like the geometric means of the given random variables. Somewhat surprisingly, the multiplicative Cauchy quotient means of i.i.d. random variables behave asymptotically in a rather different way: in o…
The complete convergence for weighted sums of sequences of independent, identically distributed random variables under sublinear expectations space was studied. By moment inequality and truncation methods, we establish the equivalent conditions of complete convergence for weighted sums of sequences of independent, identically distributed random variables under sublinear expectations space. The results extend the corresponding results obtained by Guo (2012) to those for sequences of independent, identically distributed random variables under sublinear expectations space.
Let $Ω$ be a countable infinite product $Ω^\N$ of copies of the same probability space $Ω_1$, and let ${Ξ_n}$ be the sequence of the coordinate projection functions from $Ω$ to $Ω_1$. Let $Ψ$ be a possibly nonmeasurable function from $Ω_1$ to $\R$, and let $X_n(ω) = Ψ(Ξ_n(ω))$. Then we can think of ${X_n}$ as a sequence of independent but possibly nonmeasurable random variables on $Ω$. Let $S_n = X_1+...+X_n$. By the ordinary Strong Law of Large Numbers, we almost surely have $E_*[X_1] \le \liminf S_n/n \le \limsup S_n/n \le E^*[X_1]$, where $E_*$ and $E^*$ are the lower and upper expectations…
We establish new sufficient conditions for the applicability of the strong law of large numbers (SLLN) for sequences of pairwise independent non-identically distributed random variables. These results generalize Etemadi's extension of Kolmogorov's SLLN for identically distributed random variables. Some of the obtained results hold with an arbitrary norming sequence in place of the classical normalization.
We analyze the quality of the gaussian approximation to linear combinations of n independent, identically-distributed random variables with finite fourth moments. It turns out that there exist universal, simple linear combinations that perform better than the sum of the variables. We also investigate the case in which the random variables are independent, yet they are not necessarily identically distributed.
It is shown that the Marcinkiewicz-Zygmund strong law of large numbers holds for pairwise independent identically distributed random variables. It is proved that if $X_{1}, X_{2}, \ldots$ are pairwise independent identically distributed random variables such that $E|X_{1}|^p < \infty$ for some $1 < p < 2$, then $(S_{n}-ES_{n})/n^{1/p} \to 0$ a.s. where $S_{n} = \sum_{k=1}^{n} X_{k}$.
In this paper, motived by the notion of independent and identically distributed random variables under the sub-linear expectation initiated by Peng, we give a theorem about the convergence of a random series and establish a three series theorem of independent random variables under the sub-linear expectations. As an application, we obtain the Marcinkiewicz's strong law of large numbers for independent and identically distributed random variables under the sub-linear expectations. The technical details are different from those for classical theorems because the sub-linear expectation and its re…
In this note, we extend the results about the fluctuations of the matrix entries of regular functions of Wigner random matrices obtained in arXiv:1103.3731 [math.PR] to Wigner matrices with non-i.i.d. entries provided certain Lindeberg type conditions for the fourth moments of the off-diagonal entries and the second moments of the diagonal entries are satisfied. In addition, we relax our conditions on the test functions and require that for some $s>3 \ \int (1+|k|)^{2s}\*|\hat{f}(k)|^2 \* dk <\infty.$
We give a comparison inequality that allows one to estimate the tail probabilities of sums of independent Banach space valued random variables in terms of those of independent identically distributed random variables. More precisely, let X_1,...,X_n be independent Banach-valued random variables. Let I be a random variable independent of X_1,...,X_n and uniformly distributed over {1,...,n}. Put Z_1 = X_I, and let Z_2,...,Z_n be independent identically distributed copies of Z_1. Then, P(||X_1+...+X_n|| > t) < c P(||Z_1+...+Z_n|| > t/c), for all t>0, where c is an absolute constant.
We investigate the complete $p$-th moment convergence for weighted sums of independent, identically distributed random variables under sublinear expectations space. Using moment inequality and truncation methods, we prove the equivalent conditions of complete $p$-th moment convergence of weighted sums of independent, identically distributed random variables under sublinear expectations space, which complement the corresponding results obtained in Guo and Shan (2020).
The law of large numbers is one of the most fundamental results in Probability Theory. In the case of independent sequences, there are some known characterizations; for instance, in the independent and identically distributed setting it is known that the law of large numbers is equivalent to integrability. In the case of dependent sequences, there are no known general characterizations -- to the best of our knowledge. We provide such a characterization for identically distributed Bernoulli sequences in terms of a product disintegration.
\noindent We study the asymptotic behavior of a sum of independent and identically distributed random variables conditioned by a sum of independent and identically distributed integer-valued random variables. We prove a Berry-Esseen bound in a general setting and a large deviation result when the Laplace transform of the underlying distribution is not defined in a neighborhood of zero. Then we present several combinatorial applications. In particular, we prove a large deviation result for the model of hashing with linear probing.
Let $\{X_n;n\ge 1\}$ be a sequence of independent and identically distributed random variables on a sub-linear expectation space $(Ω,\mathscr{H},\widehat{\mathbb E})$, $S_n=X_1+\ldots+X_n$. We consider the moments of $\max_{n\ge 1}|S_n|/\sqrt{2n\log\log n}$. The sufficient and necessary conditions for the moments to be finite are given. As an application, we obtain the law of the iterated logarithm for moving average processes of independent and identically distributed random variables.
We prove the following theorem. Let $X$ be a discrete field, $ξ$ and $η$ be independent identically distributed random variables with values in $X$ and distribution $μ$. The random variables $S=ξ+η$ and $D=(ξ-η)^2$ are independent if and only if $μ$ is an idempotent distribution. A similar result is also proved in the case when $ξ$ and $η$ are independent identically distributed random variables with values in the field of $p$-adic numbers $\mathbf{Q}_p$, where $p>2$, assuming that the distribution $μ$ has a continuous density.
For a sequence of identically distributed negatively associated random variables $\{X_n; n\geq 1\}$ with partial sums $S_n=\sum_{i=1}^nX_i, n\geq 1$, refinements are presented of the classical Baum-Katz and Lai complete convergence theorems. More specifically, necessary and sufficient moment conditions are provided for complete moment convergence of the form $$ \sum_{n \ge n_0} n^{r -2 -\frac{1}{pq}} a_n E(\max_{1 \le k \le n}|S_k|^{\frac{1}{q}} - εb_n^{\frac{1}{pq}})^+ < \infty $$ to hold where $r>1, q>0$ and either $n_0=1, 0<p<2, a_n=1, b_n=n$ or $n_0=3, p=2, a_n=(\log n)^{-\frac{1}{2q}}, b_…
In this paper, we give the central limit theorem and almost sure central limit theorem for products of some partial sums of independent identically distributed random variables.
This paper addresses the following classical question: giving a sequence of identically distributed random variables in the domain of attraction of a normal law, does the associated linear process satisfy the central limit theorem? We study the question for several classes of dependent random variables. For independent and identically distributed random variables we show that the central limit theorem for the linear process is equivalent to the fact that the variables are in the domain of attraction of a normal law, answering in this way an open problem in the literature. The study is also mot…
In this paper, we establish some general forms of the law of the iterated logarithm for independent random variables in a sub-linear expectation space, where the random variables are not necessarily identically distributed. Exponential inequalities for the maximum sum of independent random variables and Kolmogorov's converse exponential inequalities are established as tools for showing the law of the iterated logarithm. As an application, the sufficient and necessary conditions of the law of iterated logarithm for independent and identically distributed random variables under the sub-linear ex…
We give simple proofs, under minimal hypotheses, of the Weak Law of Large Numbers and the Central Limit Theorem for independent identically distributed random variables. These proofs use only the elementary calculus, together with the most basic notions of probability, expectations, and distribution functions
Let $X_{i,n},n\in \mathbb{N},1\leq i\leq n$, be a triangular array of independent $\mathbb{R}^d$-valued Gaussian random vectors with correlation matrices $Σ_{i,n}$. We give necessary conditions under which the row-wise maxima converge to some max-stable distribution which generalizes the class of Hüsler-Reiss distributions. In the bivariate case, the conditions will also be sufficient. Using these results, new models for bivariate extremes are derived explicitly. Moreover, we define a new class of stationary, max-stable processes as max-mixtures of Brown-Resnick processes. As an application, w…
In this note, we proved that weak limits, of sums of independent positive identically distributed random variables which are re-normalized by a non-linear shrinking transform $\max(0, x-r)$, are either degenerate or (some) compound Poisson distributions.
As an extension of a central limit theorem established by Svante Janson, we prove a Berry-Esseen inequality for a sum of independent and identically distributed random variables conditioned by a sum of independent and identically distributed integer-valued random variables.
We study functional limit theorems for linear type processes with short memory under the assumption that the innovations are dependent identically distributed random variables with infinite variance and in the domain of attraction of stable laws.
In this paper, on the sublinear expectation space, we establish a comparison theorem between independent and convolutionary random vectors, which states that the partial sums of those two sequences of random vectors are identically distributed. Under the sublinear framework, through the comparison theorem, several fundamental limit theorems for convolutionary random vectors are obtained, including the law of large numbers, the central limit theorem and the law of iterated logarithm.
Let $\{Y_i,-\infty<i<\infty\}$ be a doubly infinite sequence of identically distributed, negatively dependent random variables under sub-linear expectations, $\{a_i,-\infty<i<\infty\}$ be an absolutely summable sequence of real numbers. In this article, we study complete convergence and Marcinkiewicz-Zygmund strog law of large numbers for the partial sums of moving average processes $\{X_n=\sum_{i=-\infty}^{\infty}a_{i}Y_{i+n},n\ge 1\}$ based on the sequence $\{Y_i,-\infty<i<\infty\}$ of identically distributed, negatively dependent random variables under sub-linear expectations, complementing…
It is known that limit theorems for triangular arrays with identically distributed rows yields convergence of densities rather than just convergence in distribution. We show that this superconvergence result holds -- at least at points at which the limit density is nonzero -- even if the rows of the array are not identically distributed.
Classical Kolmogorov's and Rosenthal's inequalities for the maximum partial sums of random variables are basic tools for studying the strong laws of large numbers. In this paper, motived by the notion of independent and identically distributed random variables under the sub-linear expectation initiated by Peng (2006, 2008b), we introduce the concept of negative dependence of random variables and establish Kolmogorov's and Rosenthal's inequalities for the maximum partial sums of negatively dependent random variables under the sub-linear expectations. As an application, we show that Kolmogorov's…
A central limit theorem is proved for some strictly stationary sequences of random variables that satisfy certain mixing conditions and are subjected to the "shrinking operators" $U_r(x):=[\max\{|x|-r,0\}]\cdot x/|x|,\ r \ge 0$. For independent, identically distributed random variables, this result was proved earlier by Housworth and Shao.
Motivated by a recent work of Benoist and Quint and extending results from the PhD thesis of the third author, we obtain limit theorems for products of independent and identically distributed elements of GLd (R), such as the Marcinkiewicz-Zygmund strong law of large numbers, the CLT (with rates in Wasserstein's distances) and almost sure invariance principles with rates.
