We study n by n symmetric random matrices H, possibly discrete, with iid above-diagonal entries. We show that H is singular with probability at most exp(-n^c), and the spectral norm of the inverse of H is O(sqrt{n}). Furthermore, the spectrum of H is delocalized on the optimal scale o(n^{-1/2}). These results improve upon a polynomial singularity bound due to Costello, Tao and Vu, and they generalize, up to constant factors, results of Tao and Vu, and Erdos, Schlein and Yau.
The Restricted Invertibility problem is the problem of selecting the largest subset of columns of a given matrix $X$, while keeping the smallest singular value of the extracted submatrix above a certain threshold. In this paper, we address this problem in the simpler case where $X$ is a random matrix but with the additional constraint that the selected columns be almost orthogonal to a given vector $v$. Our main result is a lower bound on the number of columns we can extract from a normalized i.i.d. Gaussian matrix for the worst $v$.
The problem of estimating the smallest singular value of random square matrices is important in connection with matrix computations and analysis of the spectral distribution. In this survey, we consider recent developments in the study of quantitative invertibility in the non-Hermitian setting, and review some applications of this line of research.
We prove two basic conjectures on the distribution of the smallest singular value of random n times n matrices with independent entries. Under minimal moment assumptions, we show that the smallest singular value is of order n^{-1/2}, which is optimal for Gaussian matrices. Moreover, we give a optimal estimate on the tail probability. This comes as a consequence of a new and essentially sharp estimate in the Littlewood-Offord problem: for i.i.d. random variables X_k and real numbers a_k, determine the probability P that the sum of a_k X_k lies near some number v. For arbitrary coefficients a_k …
Let $σ_n(\cdot)$ denote the least singular value of a $n \times n$ matrix. It is well-known that $\mathbb{P}[σ_n(A) \le \varepsilon] \le \varepsilon n$ if $A$ is drawn from the real Ginibre ensemble of $n \times n$ matrices and $\mathbb{P}[σ_n(A) \le \varepsilon] \le \varepsilon^2 n^2$ if $A$ is drawn from the complex Ginibre ensemble. In this paper, we will show a similar phenomenon occurs for sparse random matrices.
We show that a perturbation of any fixed square matrix D by a random unitary matrix is well invertible with high probability. A similar result holds for perturbations by random orthogonal matrices; the only notable exception is when D is close to orthogonal. As an application, these results completely eliminate a hard-to-check condition from the Single Ring Theorem by Guionnet, Krishnapur and Zeitouni.
In this paper, we investigate the invertibility of sparse symmetric matrices. We show that for an $n\times n$ sparse symmetric random matrix $A$ with $A_{ij} = δ_{ij} ξ_{ij}$ is invertible with high probability. Here, $δ_{ij}$s, $i\ge j$ are i.i.d. Bernoulli random variables with $\mathbb{P} \left(ξ_{ij}=1 \right) =p \ge n^{-c}$, $ξ_{ij}, i\ge j$ are i.i.d. random variables with mean 0, variance 1 and finite forth moment $M_4$, and $c$ is constant depending on $M_4$. More precisely, $$ s_{\rm min} (A) > \varepsilon \sqrt{\frac{p}{n}}. $$ with high probability.
Let $d\geq 3$ be a fixed integer and $A$ be the adjacency matrix of a random $d$-regular directed or undirected graph on $n$ vertices. We show there exist constants $\mathfrak d>0$, \begin{align*} {\mathbb P}(\text{$A$ is singular in $\mathbb R$})\leq n^{-\mathfrak{d}}, \end{align*} for $n$ sufficiently large. This answers an open problem by Frieze [12] and Vu [28,19]. The key idea is to study the singularity probability of adjacency matrices over a finite field ${\mathbb F}_p$. The proof combines a local central limit theorem and a large deviation estimate.
Let $A$ be an $n\times n$ random matrix with independent rows $R_1(A),\dots,R_n(A)$, and assume that for any $i\leq n$ and any three-dimensional linear subspace $F\subset {\mathbb R}^n$ the orthogonal projection of $R_i(A)$ onto $F$ has distribution density $ρ(x):F\to{\mathbb R}_+$ satisfying $ρ(x)\leq C_1/\max(1,\|x\|_2^{2000})$ ($x\in F$) for some constant $C_1>0$. We show that for any fixed $n\times n$ real matrix $M$ we have $${\mathbb P}\{s_{\min}(A+M)\leq t n^{-1/2}\}\leq C'\, t,\quad\quad t>0,$$ where $C'>0$ is a universal constant. In particular, the above result holds if the rows of $…
Let $A=(a_{ij})$ be an $n\times n$ random matrix with i.i.d. entries such that $\mathbb{E} a_{11} = 0$ and $\mathbb{E} {a_{11}}^2 = 1$. We prove that for any $δ>0$ there is $L>0$ depending only on $δ$, and a subset $\mathcal{N}$ of $B_2^n$ of cardinality at most $\exp(δn)$ such that with probability very close to one we have $$A(B_2^n)\subset \bigcup_{y\in A(\mathcal{N})}\bigl(y+L\sqrt{n}B_2^n\bigr).$$ As an application, we show that for some $L'>0$ and $u\in[0,1)$ depending only on the distribution law of $a_{11}$, the smallest singular value $s_n$ of the matrix $A$ satisfies $\mathbb{P}\{s_n…
We consider a class of sparse random matrices of the form $A_n =(ξ_{i,j}δ_{i,j})_{i,j=1}^n$, where $\{ξ_{i,j}\}$ are i.i.d.~centered random variables, and $\{δ_{i,j}\}$ are i.i.d.~Bernoulli random variables taking value $1$ with probability $p_n$, and prove a quantitative estimate on the smallest singular value for $p_n = Ω(\frac{\log n}{n})$, under a suitable assumption on the spectral norm of the matrices. This establishes the invertibility of a large class of sparse matrices. For $p_n =Ω( n^{-α})$ with some $α\in (0,1)$, we deduce that the condition number of $A_n$ is of order $n$ with prob…
Let $d\geq 3$ be a fixed integer, and a prime number $p$ such that $\gcd(p,d)=1$. Let $A$ be the adjacency matrix of a random $d$-regular directed graph on $n$ vertices. We show that as a random matrix in ${\mathbb F}_p$, \begin{equation} {\mathbb P}(\text{$A$ is singular in ${\mathbb F}_p$})\leq \frac{1+{\mathrm{o}}(1)}{p-1}, \end{equation} as $n$ goes to infinity. As a consequence, as a random matrix in $\mathbb R$, \begin{equation} {\mathbb P}(\text{$A$ is singular in $\mathbb R$})={\mathrm{o}}(1) \end{equation} as $n$ goes to infinity. This answers an open problem by Frieze [12] and Vu [29…
We consider three different models of sparse random graphs:~undirected and directed Erdős-Rényi graphs, and random bipartite graph with an equal number of left and right vertices. For such graphs we show that if the edge connectivity probability $p \in (0,1)$ satisfies $n p \ge \log n + k(n)$ with $k(n) \to \infty$ as $n \to \infty$, then the adjacency matrix is invertible with probability approaching one (here $n$ is the number of vertices in the two former cases and the number of left and right vertices in the latter case). If $np \le \log n -k(n)$ then these matrices are invertible with pro…
Let $p \in (0,1/2)$ be fixed, and let $B_n(p)$ be an $n\times n$ random matrix with i.i.d. Bernoulli random variables with mean $p$. We show that for all $t \ge 0$, \[\mathbb{P}[s_n(B_n(p)) \le tn^{-1/2}] \le C_p t + 2n(1-p)^{n} + C_p (1-p-ε_p)^{n},\] where $s_n(B_n(p))$ denotes the least singular value of $B_n(p)$ and $C_p, ε_p > 0$ are constants depending only on $p$. In particular, \[\mathbb{P}[B_{n}(p) \text{ is singular}] = 2n(1-p)^{n} + C_{p}(1-p-ε_p)^{n},\] which confirms a conjecture of Litvak and Tikhomirov. We also confirm a conjecture of Nguyen by showing that if $Q_{n}$ is an $n\ti…
We study invertibility of matrices of the form $D+R$ where $D$ is an arbitrary symmetric deterministic matrix, and $R$ is a symmetric random matrix whose independent entries have continuous distributions with bounded densities. We show that $|(D+R)^{-1}| = O(n^2)$ with high probability. The bound is completely independent of $D$. No moment assumptions are placed on $R$; in particular the entries of $R$ can be arbitrarily heavy-tailed.
We study the lower tail behavior of the least singular value of an $n\times n$ random matrix $M_n := M+N_n$, where $M$ is a fixed complex matrix with operator norm at most $\exp(n^{c})$ and $N_n$ is a random matrix, each of whose entries is an independent copy of a complex random variable with mean $0$ and variance $1$. Motivated by applications, our focus is on obtaining bounds which hold with extremely high probability, rather than on the least singular value of a typical such matrix. This setting has previously been considered in a series of influential works by Tao and Vu, most notably in …
Limiting Spectral Distributions (LSD) of real symmetric patterned matrices have been well-studied. In this article, we consider skew-symmetric/anti-symmetric patterned random matrices and establish the LSDs of several common matrices. For the skew-symmetric Wigner, skew-symmetric Toeplitz and the skew-symmetric Circulant, the LSDs (on the imaginary axis) are the same as those in the symmetric cases. For the skew-symmetric Hankel and the skew-symmetric Reverse Circulant however, we obtain new LSDs. We also show the existence of the LSDs for the triangular versions of these matrices. We then int…
We obtain lower tail estimates for the smallest singular value of random matrices with independent but non-identically distributed entries. Specifically, we consider $n\times n$ matrices with complex entries of the form \[ M = A\circ X + B = (a_{ij}ξ_{ij} + b_{ij}) \] where $X=(ξ_{ij})$ has iid centered entries of unit variance and $A$ and $B$ are fixed matrices. In our main result we obtain polynomial bounds on the smallest singular value of $M$ for the case that $A$ has bounded (possibly zero) entries, and $B= Z\sqrt{n}$ where $Z$ is a diagonal matrix with entries bounded away from zero. As …
Let $X,X_1,...,X_n$ be independent identically distributed random variables. In this paper we study the behavior of the concentration functions of the weighted sums $\sum\limits_{k=1}^{n}a_k X_k$ with respect to the arithmetic structure of coefficients $a_k$. Such concentration results recently became important in connection with investigations about singular values of random matrices. In this paper we formulate and prove some refinements of a result of Vershynin (R. Vershynin, Invertibility of symmetric random matrices, arXiv:1102.0300. (2011). Published in Random Structures and Algorithms, v…
In this article, we study the fluctuation of linear eigenvalue statistics of symmetric circulant matrices $(SC_n)$ with independent entries which satisfy some moment conditions. We show that $\frac{1}{\sqrt{n}} \Tr ϕ(SC_n)$ obey the central limit theorem (CLT) type result, where $ϕ$ is a nice test function.
We consider Brownian motions and other processes (Ornstein-Uhlenbeck processes, spherical Brownian motions) on various sets of symmetric matrices constructed from algebra structures, and look at their associated spectral measure processes. This leads to the identification of the multiplicity of the eigenvalues, together with the identification of the spectral measures. For Clifford algebras, we thus recover Bott's periodicity.
We prove that the (non-symmetric) adjacency matrix of a uniform random $d$-regular directed graph on $n$ vertices is asymptotically almost surely invertible, assuming $\min(d,n-d)\ge C\log^2n$ for a sufficiently large constant $C>0$. The proof makes use of a coupling of random regular digraphs formed by "shuffling" the neighborhood of a pair of vertices, as well as concentration results for the distribution of edges recently obtained by the author (arXiv:1410.5595). We also apply our general approach to prove a.a.s.\ invertibility of Hadamard products $Σ\circ Ξ$, where $Ξ$ is a matrix of iid u…
In this paper we give a simple, short, and self-contained proof for a non-trivial upper bound on the probability that a random $\pm 1$ symmetric matrix is singular.
Motivated by isotropic fully developed turbulence, we define a theory of symmetric matrix valued isotropic Gaussian multiplicative chaos. Our construction extends the scalar theory developed by J.P. Kahane in 1985.
We prove that few largest (and most important) eigenvalues of random symmetric matrices of various kinds are very strongly concentrated. This strong concentration enables us to compute the means of these eigenvalues with high precision. Our approach uses Talagrand's inequality and is very different from standard approaches.
