arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1507.08847cs.LGcs.CVcs.NAmath.NA
收藏

一种基于稀疏编码和超预测器学习的新型多变量性能优化方法

A novel multivariate performance optimization method based on sparse coding and hyper-predictor learning

School of Electronic Information Engineering, Tianjin University, Tianjin 300072, China(电子信息工程学院,天津大学);College of Information Science and Technology, University of Nebraska Omaha, Omaha, NE 68182,United States(信息科学与技术学院,内布拉斯加大学奥马哈分校)

Jiachen Yanga, Zhiyong Dinga, Fei Guoa, Huogen Wanga, Nick Hughesb

AI总结:

本文提出一种新型方法,通过稀疏编码和超预测器学习优化多变量性能度量,通过联合优化问题最小化重建误差、稀疏性及复杂损失函数上界。

摘要:

本文研究了多变量性能度量的优化问题,提出了一种新算法。与传统机器学习方法不同,本文研究如何学习有效超预测器以处理数据点元组,从而最小化对应于多变量性能度量的复杂损失函数。我们提出将数据点元组通过字典转换为稀疏码元组,然后应用线性函数比较稀疏码与给定候选类别标签。为了学习字典、稀疏码和线性函数参数,我们提出一个联合优化问题。在此问题中,同时最小化稀疏码的重建误差和稀疏性,以及复杂损失函数的上界。此外,损失函数的上界通过稀疏码和线性函数参数近似。为优化此问题,我们开发了一种基于下降梯度方法的迭代算法,交替学习稀疏码和超预测器参数。在一些基准数据集上的实验结果表明,所提方法优于其他最先进的算法。

英文摘要:

In this paper, we investigate the problem of optimization multivariate performance measures, and propose a novel algorithm for it. Different from traditional machine learning methods which optimize simple loss functions to learn prediction function, the problem studied in this paper is how to learn effective hyper-predictor for a tuple of data points, so that a complex loss function corresponding to a multivariate performance measure can be minimized. We propose to present the tuple of data points to a tuple of sparse codes via a dictionary, and then apply a linear function to compare a sparse code against a give candidate class label. To learn the dictionary, sparse codes, and parameter of the linear function, we propose a joint optimization problem. In this problem, the both the reconstruction error and sparsity of sparse code, and the upper bound of the complex loss function are minimized. Moreover, the upper bound of the loss function is approximated by the sparse codes and the linear function parameter. To optimize this problem, we develop an iterative algorithm based on descent gradient methods to learn the sparse codes and hyper-predictor parameter alternately. Experiment results on some benchmark data sets show the advantage of the proposed methods over other state-of-the-art algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑