arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1908.09362cs.LGcs.AI
收藏

LightMC:一种动态高效的多类分解算法

LightMC: A Dynamic and Efficient Multiclass Decomposition Algorithm

Peking University(北京大学);Microsoft Research(微软研究院)

Ziyu Liu, Guolin Ke, Jiang Bian, Tieyan Liu

摘要:

多类分解将多类分类问题分解为一系列独立的二进制学习器,并通过组合它们的输出来重构多类分类结果。这种分解方法的三种广泛使用的实现是One-Versus-All(OVA)、One-Versus-One(OVO)和纠错输出代码(ECOC)。而OVA和OVO都很简单,它们都假设所有的类都是正交的,忽略了现实世界中类之间的潜在相关性。另一方面,基于纠错输出码(ECOC)的分解方法由于其集成了类之间的相关性而更受欢迎。然而,现有的基于EECC的方法的性能高度依赖于编码矩阵和解码策略的设计。然而,要找到一个有效的编码矩阵并采用合适的解码策略是相当不确定和耗时的。为了解决这个问题,我们提出了LightMC,一个高效的动态多类分解算法。LightMC没有使用固定的编码矩阵和解码策略,而是使用了可微分解码策略,这使得它能够动态优化编码矩阵和解码策略,通过反向传播与迭代方式的基础学习器的训练相结合,提高多类分类的整体准确性。在几个公开的大规模多类分类数据集上的实验结果表明,LightMC具有良好的准确性和高效率。

英文摘要:

Multiclass decomposition splits a multiclass classification problem into a series of independent binary learners and recomposes them by combining their outputs to reconstruct the multiclass classification results. Three widely-used realizations of such decomposition methods are One-Versus-All (OVA), One-Versus-One (OVO), and Error-Correcting-Output-Code (ECOC). While OVA and OVO are quite simple, both of them assume all classes are orthogonal which neglect the latent correlation between classes in real-world. Error-Correcting-Output-Code (ECOC) based decomposition methods, on the other hand, are more preferable due to its integration of the correlation among classes. However, the performance of existing ECOC-based methods highly depends on the design of coding matrix and decoding strategy. Unfortunately, it is quite uncertain and time-consuming to discover an effective coding matrix with appropriate decoding strategy. To address this problem, we propose LightMC, an efficient dynamic multiclass decomposition algorithm. Instead of using fixed coding matrix and decoding strategy, LightMC uses a differentiable decoding strategy, which enables it to dynamically optimize the coding matrix and decoding strategy, toward increasing the overall accuracy of multiclass classification, via back propagation jointly with the training of base learners in an iterative way. Empirical experimental results on several public large-scale multiclass classification datasets have demonstrated the effectiveness of LightMC in terms of both good accuracy and high efficiency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑