arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1603.05850cs.LG
收藏

N元纠错编码方案

N-ary Error Correcting Coding Scheme

Institute of High Performance Computing(高性能计算研究所);University of Sydney(悉尼大学);Nanyang Technological University(南洋理工大学);Berlin Institute of Technology(柏林工业大学);Korea University(高丽大学)

Joey Tianyi Zhou, Ivor W. Tsang, Shen-Shyang Ho, Klaus-Robert Muller

摘要:

编码矩阵的设计对基于纠错输出码的多类任务的预测性能起着至关重要的作用。{In多类分类问题,例如,细粒度分类,由于编码值的有限选择,在现有编码方案下难以区分细微的类间差异。在本文中,我们研究是否可以放宽现有的二进制和三进制码设计$N$ -ary码设计,以实现更好的分类性能。{In特别地,我们提出了一种新的$N$ -ary编码方案,该方案将原始多类问题分解为更简单的多类子问题,这类似于应用分治方法。这种编码方案的两个主要优点如下:(i)构造更多鉴别码的能力和(ii)用户选择用于基于ECC的分类的最佳$N$的灵活性。我们的经验表明,最佳的$N$(基于分类性能)在于$[3, 10]$与一些权衡计算成本。此外,我们提供了理论上的见解的泛化误差界的$N$ -ary ECOC上的平均基础分类器泛化误差和任何两个代码之间的最小距离的依赖。在基准多类数据集上的实验结果表明,该编码方案比现有的编码方法具有更好的预测性能。

英文摘要:

The coding matrix design plays a fundamental role in the prediction performance of the error correcting output codes (ECOC)-based multi-class task. {In many-class classification problems, e.g., fine-grained categorization, it is difficult to distinguish subtle between-class differences under existing coding schemes due to a limited choices of coding values.} In this paper, we investigate whether one can relax existing binary and ternary code design to $N$-ary code design to achieve better classification performance. {In particular, we present a novel $N$-ary coding scheme that decomposes the original multi-class problem into simpler multi-class subproblems, which is similar to applying a divide-and-conquer method.} The two main advantages of such a coding scheme are as follows: (i) the ability to construct more discriminative codes and (ii) the flexibility for the user to select the best $N$ for ECOC-based classification. We show empirically that the optimal $N$ (based on classification performance) lies in $[3, 10]$ with some trade-off in computational cost. Moreover, we provide theoretical insights on the dependency of the generalization error bound of an $N$-ary ECOC on the average base classifier generalization error and the minimum distance between any two codes constructed. Extensive experimental results on benchmark multi-class datasets show that the proposed coding scheme achieves superior prediction performance over the state-of-the-art coding methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑