arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.10218math.STmath.PRstat.TH
收藏

二次极小极大的构造性与相合估计

Constructive and consistent estimation of quadratic minimax

Philip Kennerberg, Ernst C. Wit

AI总结:

针对多环境下二次风险仿射组合最大值的argmin解集估计问题,提出构造性相合估计方法,并设计基于二分法的高效近似估计器,应用于结构方程模型的最坏风险最小化。

摘要:

我们考虑k个平方可积随机变量Y₁,…,Y_k,以及k个长度为p的随机(行)向量X₁,…,X_k,满足对1≤i≤k和1≤l≤p,X_i(l)均为平方可积。我们对X_i与Y_i之间的关系不做任何假设,将每一组X_i与Y_i的配对称为一个环境。我们为每个环境构造平方风险函数R_i(β)=𝔼[(Y_i−βX_i)²],并考虑这k个风险函数的m个仿射组合。随后我们定义参数空间Θ,其中每个点对应一个环境下(X_i,Y_i)协方差矩阵的唯一元素的一个子集。接着我们研究这些二次风险函数的m个仿射组合的最大值的argmin解集的估计问题。我们提出了一种构造性方法来估计整个argmin解集,该方法在Θ^k中的一个零测集之外几乎必然相合。由于该方法涉及求解一般次数的多项式,计算成本较高。为解决这一问题,我们定义了另一种基于二分法的近似估计器,同样能实现解集的相合估计,且计算效率大幅提升。我们将该方法应用于结构方程模型场景下的最坏风险最小化问题。

英文摘要:

We consider $k$ square integrable random variables $Y_1,...,Y_k$ and $k$ random (row) vectors of length $p$, $X_1,...,X_k$ such that $X_i(l)$ is square integrable for $1\le i\le k$ and $1\le l\le p$. No assumptions whatsoever are made of any relationship between the $X_i$:s and $Y_i$:s. We shall refer to each pairing of $X_i$ and $Y_i$ as an environment. We form the square risk functions $R_i(β)=\mathbb{E}\left[(Y_i-βX_i)^2\right]$ for every environment and consider $m$ affine combinations of these $k$ risk functions. Next, we define a parameter space $Θ$ where we associate each point with a subset of the unique elements of the covariance matrix of $(X_i,Y_i)$ for an environment. Then we study estimation of the $\arg\min$-solution set of the maximum of a the $m$ affine combinations the of quadratic risk functions. We provide a constructive method for estimating the entire $\arg\min$-solution set which is consistent almost surely outside a zero set in $Θ^k$. This method is computationally expensive, since it involves solving polynomials of general degree. To overcome this, we define another approximate estimator that also provides a consistent estimation of the solution set based on the bisection method, which is computationally much more efficient. We apply the method to worst risk minimization in the setting of structural equation models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑