现代数据集正趋向于越来越高的维度。作为回应,近期关于协方差估计的理论研究通常采用比例增长渐近框架,即样本量$n$和维度$p$相当,且$n, p \rightarrow \infty$及$\gamma_n = p/n \rightarrow \gamma > 0$。然而,许多数据集——可能是大多数——的行数和列数差异很大。我们转而考虑非比例增长渐近框架,其中$n, p \rightarrow \infty$且$\gamma_n \rightarrow 0$或$\gamma_n \rightarrow \infty$。任一非比例极限都会引发先前比例和固定$p$分析中未曾见过的新现象。我们研究了尖峰协方差模型,其理论协方差是单位矩阵的低秩扰动。对于15种不同的损失函数,我们以封闭形式展示了新的最优收缩和阈值化规则。我们的最优方法需要广泛的特征值收缩,并且与标准经验协方差估计器相比,提供了显著的性能优势。实践者可能会问,应将其数据视为产生于比例框架还是非比例框架(并应用相应的方法)。令人欣慰的是,可以保持框架不可知:一套统一的封闭形式收缩规则(仅取决于给定数据的宽高比$\gamma_n$)在两种框架下均提供完全的渐近最优性。我们所探索现象的核心是spiked Wigner模型,其中低秩矩阵受到对称噪声的扰动。利用与$\gamma_n \rightarrow 0$时尖峰协方差模型的联系,我们推导出了用于估计低秩分量的最优特征值收缩规则,这具有独立且基础的研究价值。
英文摘要:
Modern datasets are trending towards ever higher dimension. In response, recent theoretical studies of covariance estimation often assume the proportional-growth asymptotic framework, where the sample size $n$ and dimension $p$ are comparable, with $n, p \rightarrow \infty $ and $γ_n = p/n \rightarrow γ> 0$. Yet, many datasets -- perhaps most -- have very different numbers of rows and columns. We consider instead the disproportional-growth asymptotic framework, where $n, p \rightarrow \infty$ and $γ_n \rightarrow 0$ or $γ_n \rightarrow \infty$. Either disproportional limit induces novel behavior unseen within previous proportional and fixed-$p$ analyses. We study the spiked covariance model, with theoretical covariance a low-rank perturbation of the identity. For each of 15 different loss functions, we exhibit in closed form new optimal shrinkage and thresholding rules. Our optimal procedures demand extensive eigenvalue shrinkage and offer substantial performance benefits over the standard empirical covariance estimator.
Practitioners may ask whether to view their data as arising within (and apply the procedures of) the proportional or disproportional frameworks. Conveniently, it is possible to remain {\it framework agnostic}: one unified set of closed-form shrinkage rules (depending only on the aspect ratio $γ_n$ of the given data) offers full asymptotic optimality under either framework. At the heart of the phenomena we explore is the spiked Wigner model, in which a low-rank matrix is perturbed by symmetric noise. Exploiting a connection to the spiked covariance model as $γ_n \rightarrow 0$, we derive optimal eigenvalue shrinkage rules for estimation of the low-rank component, of independent and fundamental interest.
Shrinkage estimation of covariance matrix for portfolio choice with high frequency data
本文研究了当投资组合规模较大时,高频数据在估计投资组合选择的协方差阵中的有用性。本文分两步提出了一种便于计算的金融资产综合协方差(ICV)矩阵的非线性收缩估计。ICV的特征向量首先构造从一个设计的时间变化调整实现的协方差阵的无噪声的对数回报的相对较低的频率数据。然后基于高频数据采用拟极大似然估计ICV的正则化特征值。估计量总是正定的,它的逆是ICV的逆的估计量。它最大限度地减少了旋转等价估计类内的投资组合收益率的样本方差的限制。当标的资产的数量大于每个资产的时间序列观测值的数量,并且资产价格遵循一般随机过程时,它就起作用了。我们的理论结果是在假设资产数(p)和样本量(n)满足p/n \to y >0的条件下得出的。我们提出的估计的优点是使用实际数据证明。