arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1206.6478cs.LGstat.ML
收藏

最大容限输出编码

Maximum Margin Output Coding

Carnegie Mellon University(卡内基梅隆大学)

Yi Zhang, Jeff Schneider

摘要:

在本文中,我们研究了多标签预测的输出编码。为了使多标签输出编码是有区别的,重要的是不同标签向量的码字彼此显著不同。同时,与传统的编码理论不同,输出编码中的码字是从输入预测的,因此具有可预测的标签编码也是至关重要的。为了找到既有区别又可预测的输出代码,我们首先提出了一个最大保证金公式,自然地捕捉这两个属性。然后,我们将其转换为一个度量学习公式,但与结构化预测问题中常见的指数级大量的约束。如果没有用于易处理推理的标签结构,我们使用过度生成(即,松弛)技术与用于优化的切割平面方法相结合。在我们的实证研究中,所提出的输出编码方案优于各种现有的多标签预测方法的图像,文本和音乐分类。

英文摘要:

In this paper we study output coding for multi-label prediction. For a multi-label output coding to be discriminative, it is important that codewords for different label vectors are significantly different from each other. In the meantime, unlike in traditional coding theory, codewords in output coding are to be predicted from the input, so it is also critical to have a predictable label encoding. To find output codes that are both discriminative and predictable, we first propose a max-margin formulation that naturally captures these two properties. We then convert it to a metric learning formulation, but with an exponentially large number of constraints as commonly encountered in structured prediction problems. Without a label structure for tractable inference, we use overgenerating (i.e., relaxation) techniques combined with the cutting plane method for optimization. In our empirical study, the proposed output coding scheme outperforms a variety of existing multi-label prediction methods for image, text and music classification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑