arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1911.08975eess.SP
收藏

基于秩一投影的词典学习(ROP)

Dictionary Learning Using Rank-One Projection (ROP)

Cheng Cheng, Wei Dai

摘要:

字典学习的目标是找到一个能够稀疏表示训练数据的字典。文献中的方法通常将字典学习问题公式化为关于两个变量的优化,即,字典和稀疏系数,并通过在两个阶段之间交替来解决它:稀疏编码和字典更新。这项工作的主要贡献是一个秩一投影(ROP)的制定,字典学习是铸造作为一个优化相对于一个单一的变量,这是一组秩一矩阵。因此,所得到的算法是单阶段的。一个交替方向的乘数法(ADMM)推导出解决优化问题,并保证了全局收敛,尽管非凸的优化配方。此外,ROP减少了其他基准测试算法所需的调优参数的数量。数值试验表明,ROP优于其他基准的合成和实际数据,特别是当样本数是小的。

英文摘要:

Dictionary learning aims to find a dictionary that can sparsely represent the training data. Methods in the literature typically formulate the dictionary learning problem as an optimisation with respect to two variables, i.e., dictionary and sparse coefficients, and solve it by alternating between two stages: sparse coding and dictionary update. The key contribution of this work is a Rank-One Projection (ROP) formulation where dictionary learning is cast as an optimisation with respect to a single variable which is a set of rank one matrices. The resulting algorithm is hence single staged. An alternating direction method of multipliers (ADMM) is derived to solve the optimisation problem and guarantees a global convergence despite non-convexity of the optimisation formulation. Also ROP reduces the number of tuning parameters required in other benchmark algorithms. Numerical tests demonstrate that ROP outperforms other benchmarks for both synthetic and real data especially when the sample number is small.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑