A Decomposition Algorithm for the Sparse Generalized Eigenvalue Problem
Center for Quantum Computing, Peng Cheng Laboratory(鹏城实验室量子计算中心);Tencent AI Lab(腾讯AI实验室);School of Data and Computer Science, Sun Yat-sen University(中山大学数据与计算机科学学院)
The sparse generalized eigenvalue problem arises in a number of standard and modern statistical learning models, including sparse principal component analysis, sparse Fisher discriminant analysis, and sparse canonical correlation analysis. However, this problem is difficult to solve since it is NP-hard. In this paper, we consider a new decomposition method to tackle this problem. Specifically, we use random or/and swapping strategies to find a working set and perform global combinatorial search over the small subset of variables. We consider a bisection search method and a coordinate descent method for solving the quadratic fractional programming subproblem. In addition, we provide some theoretical analysis for the proposed method. Our experiments have shown that the proposed method significantly and consistently outperforms existing solutions in term of accuracy.
Continuous Finite Element Method For Maxwell Eigenvalue Problems With Regular Decomposition Technique
Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);School of Mathematical Sciences, University of Chinese Academy of Sciences(中国科学院大学数学科学学院)
Accurate eigenvalue decomposition of arrowhead matrices and applications
Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture, University of Split(斯普利特大学电气、机械和造船工程学院);Department of Computer Science and Engineering, The Pennsylvania State University(宾夕法尼亚州立大学计算机科学与工程系)
A Symmetry-based Decomposition Approach to Eigenvalue Problems: Formulation, Discretization, and Implementation
Institute of Computational Mathematics and Scientific/Engineering Computing, Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院计算数学与科学工程计算研究所);Graduate University of Chinese Academy of Sciences(中国科学院大学);Institute of Applied Physics and Computational Mathematics(应用物理与计算数学研究所)
Forward stable eigenvalue decomposition of rank-one modifications of diagonal matrices
Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture, University of Split(斯普利特大学电气、机械与航海工程学院);Department of Computer Science and Engineering, The Pennsylvania State University(宾夕法尼亚州立大学计算机科学与工程系)
对于具有小的非对角(数值)秩和分层半可分形式的稠密埃尔米特矩阵,我们给出了一种具有近似线性复杂度的稳定分治特征分解方法(称为SuperDC),该方法显着改进了[Vogel,Xia,et al.,Siam J. Sci.计算:38(2016)]。我们采用了一系列的关键稳定性技术,并提供了许多改进的算法设计。分析了原算法的各种稳定性风险,包括潜在的指数范数增长,取消,与集群特征值或中间特征值的准确性损失等。在划分阶段,我们给出了一个新的结构化低秩更新策略与平衡,消除指数范数增长,也最大限度地减少低秩更新的秩。在低秩更新特征值解的征服阶段,原算法直接使用正则快速多极子方法(FMM)加速函数求值,存在取消、被零除和收敛速度慢的风险。在这里,我们设计了一个三角形FMM,以避免取消。此外,当有集群的中间特征值或现有的特征值的更新是非常小的,我们设计了一种新的本地移位策略集成FMM加速度到移位长期方程的解决方案,以实现效率和可靠性。我们还提供了一些改进或澄清的一些结构和技术,在以前的工作中缺失或不清楚。由此产生的SuperDC特征值求解器具有显着更好的稳定性,同时保持接近线性的复杂性,找到整个特征值分解。在一组综合测试中,SuperDC显示出比Matlab $\textsf{eig}$函数显著更低的运行时间和存储,以及更多的稳定性优势。
Relaxed Sparse Eigenvalue Conditions for Sparse Estimation via Non-convex Regularized Regression
Department of Automation, Tsinghua University, Beijing 100084, P.R.China(自动化系,清华大学,北京100084,中国);State Key Lab of Intelligent Technologies and Systems(智能技术与系统国家重点实验室);Tsinghua National Laboratory for Information Science and Technology(TNList)(信息科学与技术国家实验室(清华大学))