arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.06605math.OC
收藏

梯度投影牛顿算法在稀疏协同学习中的应用

Gradient Projection Newton Algorithm for Sparse Collaborative Learning Using Synthetic and Real Datasets of Applications

Jun Sun, Lingchen Kong, Shenglong Zhou

摘要:

探索来自同一组的多组数据之间的关系使从业者能够在医学科学和工程中做出更好的决策。在本文中,我们提出了一个稀疏协作学习(SCL)模型,一个优化与双稀疏约束,处理问题的两组数据和一个共享的响应变量。它能够处理依赖于响应变量的离散性的分类问题或回归问题,以及同时探索两个数据集之间的关系。为了求解SCL,我们首先给出了一些最优性的充分必要条件,然后设计了一个梯度投影牛顿算法,该算法已被证明以至少平方收敛速率全局收敛到唯一的局部最优解.最后,数值实验验证了该方法的有效性.

英文摘要:

Exploring the relationship among multiple sets of data from one same group enables practitioners to make better decisions in medical science and engineering. In this paper, we propose a sparse collaborative learning (SCL) model, an optimization with double-sparsity constraints, to process the problem with two sets of data and a shared response variable. It is capable of dealing with the classification problems or the regression problems dependent on the discreteness of the response variable as well as exploring the relationship between two datasets simultaneously. To solve SCL, we first present some necessary and sufficient optimality conditions and then design a gradient projection Newton algorithm which has proven to converge to a unique locally optimal solution globally with at least a quadratic convergence rate. Finally, the reported numerical experiments illustrate the efficiency of the proposed method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑