语义通道与Shannon通道相互匹配的多标签分类
Semantic Channel and Shannon's Channel Mutually Match for Multi-Label Classification
摘要:
一组转移概率函数形成香农通道,而一组真值函数形成语义通道。标签学习是让语义通道匹配Shannon通道,标签选择是让Shannon通道匹配语义通道。信道匹配(CM)算法被提供用于多标签分类。该算法遵循最大语义信息准则,与最大似然准则和正则化最小二乘准则兼容。当样本量很大时,可以利用第三类贝叶斯定理直接将Shannon通道转换为语义通道;当样本量很大时,可以利用采样分布训练带参数的真值函数。标签可以是一些原子标签的布尔函数。为了简化学习,我们可以只获得一些原子标签的真值函数。对于一个给定的标签,实例分为三种(积极,消极,不清楚),而不是在流行的研究中的两种,这样的问题与二元相关性是避免的。对于每个实例,分类器选择具有最多语义信息或最丰富内涵的复合标签。作为一种预测模型,语义通道不随实例的先验概率分布(源)而改变。当源发生变化时,它仍然有效。分类器随信源的变化而变化,从而克服了类不平衡问题。研究表明,老年人口的增加会改变“老”的量词,并推动“老”的语义演变。介绍了未知实例分类的CM迭代算法。
英文摘要:
A group of transition probability functions form a Shannon's channel whereas a group of truth functions form a semantic channel. Label learning is to let semantic channels match Shannon's channels and label selection is to let Shannon's channels match semantic channels. The Channel Matching (CM) algorithm is provided for multi-label classification. This algorithm adheres to maximum semantic information criterion which is compatible with maximum likelihood criterion and regularized least squares criterion. If samples are very large, we can directly convert Shannon's channels into semantic channels by the third kind of Bayes' theorem; otherwise, we can train truth functions with parameters by sampling distributions. A label may be a Boolean function of some atomic labels. For simplifying learning, we may only obtain the truth functions of some atomic label. For a given label, instances are divided into three kinds (positive, negative, and unclear) instead of two kinds as in popular studies so that the problem with binary relevance is avoided. For each instance, the classifier selects a compound label with most semantic information or richest connotation. As a predictive model, the semantic channel does not change with the prior probability distribution (source) of instances. It still works when the source is changed. The classifier changes with the source, and hence can overcome class-imbalance problem. It is shown that the old population's increasing will change the classifier for label "Old" and has been impelling the semantic evolution of "Old". The CM iteration algorithm for unseen instance classification is introduced.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。