arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.06488stat.ME
收藏

稀疏泛函线性判别分析

Sparse Functional Linear Discriminant Analysis

Juhyun Park, Jeongyoun Ahn, Yongho Jeon

摘要:

函数线性判别分析提供了一种简单而有效的分类方法,有可能实现完美的分类。在文献中提出了几种方法,主要解决问题的维度。另一方面,人们对分析的可解释性越来越感兴趣,这有利于简单和稀疏的解决方案。在这项工作中,我们提出了一种新的方法,采用了一种类型的稀疏性,识别非零子域的功能设置,提供了一个解决方案,更容易解释,而不影响性能。由于需要在解中嵌入额外的约束,我们将泛函线性判别分析重新表述为具有适当惩罚的正则化问题。受$\ell_1$型正则化在标量变量诱导零系数方面的成功启发,我们开发了一种新的用于泛函线性判别分析的正则化方法,该方法结合了$\ell_1$型惩罚$\int |f|$来诱导零区域。我们证明,我们的配方有一个定义良好的解决方案,包含零区域,实现功能的稀疏性域选择的意义。此外,正则化的解决方案的误分类概率收敛到贝叶斯错误,如果数据是高斯。我们的方法不假设基础函数在域中具有零区域,而是产生一个稀疏估计器,该估计器始终估计真实函数,无论后者是否稀疏。与现有方法的数值比较表明,在有限样本的模拟和真实数据的例子,这一属性。

英文摘要:

Functional linear discriminant analysis offers a simple yet efficient method for classification, with the possibility of achieving a perfect classification. Several methods are proposed in the literature that mostly address the dimensionality of the problem. On the other hand, there is a growing interest in interpretability of the analysis, which favors a simple and sparse solution. In this work, we propose a new approach that incorporates a type of sparsity that identifies non-zero sub-domains in the functional setting, offering a solution that is easier to interpret without compromising performance. With the need to embed additional constraints in the solution, we reformulate the functional linear discriminant analysis as a regularization problem with an appropriate penalty. Inspired by the success of $\ell_1$-type regularization at inducing zero coefficients for scalar variables, we develop a new regularization method for functional linear discriminant analysis that incorporates an $L^1$-type penalty, $\int |f|$, to induce zero regions. We demonstrate that our formulation has a well defined solution that contains zero regions, achieving a functional sparsity in the sense of domain selection. In addition, the misclassification probability of the regularized solution is shown to converge to the Bayes error if the data are Gaussian. Our method does not presume that the underlying function has zero regions in the domain, but produces a sparse estimator that consistently estimates the true function whether or not the latter is sparse. Numerical comparisons with existing methods demonstrate this property in finite samples with both simulated and real data examples.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑