arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 1203.3530cs.LGcs.CVstat.ML
收藏

基于混合生成/判别学习的图像自动标注

Hybrid Generative/Discriminative Learning for Automatic Image Annotation

College of Computing(计算机学院);Georgia Institute of Technology(佐治亚理工学院)

Shuang Hong Yang, Jiang Bian, Hongyuan Zha

摘要:

自动图像注释(AIA)对机器学习提出了巨大的挑战,因为它需要对输入和输出都模糊的数据进行建模,例如,图像包含多个对象并标记有多个语义标签。更具挑战性的是,候选标签的数量通常是巨大的(与词汇大小一样大),但每个图像只与其中的几个相关。本文提出了一种混合生成判别分类器,同时解决极端的数据模糊性和过拟合的脆弱性问题,如AIA的任务。特别是:(1)建立指数-多项混合(EMM)模型,以捕获输入和输出的模糊性,同时鼓励预测稀疏性;(2)通过结合图模型的变分推理和有序回归的成对公式的判别学习,显式地最大化EMM模型的预测能力。实验表明,我们的方法实现了卓越的注释性能和更好的标签可扩展性。

英文摘要:

Automatic image annotation (AIA) raises tremendous challenges to machine learning as it requires modeling of data that are both ambiguous in input and output, e.g., images containing multiple objects and labeled with multiple semantic tags. Even more challenging is that the number of candidate tags is usually huge (as large as the vocabulary size) yet each image is only related to a few of them. This paper presents a hybrid generative-discriminative classifier to simultaneously address the extreme data-ambiguity and overfitting-vulnerability issues in tasks such as AIA. Particularly: (1) an Exponential-Multinomial Mixture (EMM) model is established to capture both the input and output ambiguity and in the meanwhile to encourage prediction sparsity; and (2) the prediction ability of the EMM model is explicitly maximized through discriminative learning that integrates variational inference of graphical models and the pairwise formulation of ordinal regression. Experiments show that our approach achieves both superior annotation performance and better tag scalability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑