arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1202.0855cs.LGstat.ML
收藏

半监督多任务多视角学习的重构误差公式

A Reconstruction Error Formulation for Semi-Supervised Multi-task and Multi-view Learning

University of California, Davis(加州大学戴维斯分校)

Buyue Qian, Xiang Wang, Ian Davidson

摘要:

使学习技术更适合于通用用途的一个重大挑战是超越i)完全监督,ii)低维数据,iii)每个实例的单个任务和单个视图。解决这些挑战允许处理通常具有多个(但可能不完整)标签和视图的高维“大数据”问题。虽然其他工作已经分别解决了这些问题,但在本文中,我们将展示如何将它们结合在一起,即多任务和多视图学习的半监督降维(SSDR-MML),它在半监督设置中对降维和标签推理进行优化。所提出的框架旨在处理多任务和多视图的学习设置,可以很容易地适应许多有用的应用程序。从所有任务和视图获得的信息通过重建误差以线性方式组合,可以使用交替优化方案有效地解决。我们的配方有许多优点。我们明确建模的信息组合机制作为一个数据结构(权重/最近邻矩阵),它允许调查多任务和多视图学习的基本问题。我们解决这样一个问题,提出了一个通用的措施,以量化的成功,同时学习多个任务或从多个角度。我们表明,我们的SSDR-MML方法可以优于许多最先进的基线方法,并证明了将降维和学习联系起来的有效性。

英文摘要:

A significant challenge to make learning techniques more suitable for general purpose use is to move beyond i) complete supervision, ii) low dimensional data, iii) a single task and single view per instance. Solving these challenges allows working with "Big Data" problems that are typically high dimensional with multiple (but possibly incomplete) labelings and views. While other work has addressed each of these problems separately, in this paper we show how to address them together, namely semi-supervised dimension reduction for multi-task and multi-view learning (SSDR-MML), which performs optimization for dimension reduction and label inference in semi-supervised setting. The proposed framework is designed to handle both multi-task and multi-view learning settings, and can be easily adapted to many useful applications. Information obtained from all tasks and views is combined via reconstruction errors in a linear fashion that can be efficiently solved using an alternating optimization scheme. Our formulation has a number of advantages. We explicitly model the information combining mechanism as a data structure (a weight/nearest-neighbor matrix) which allows investigating fundamental questions in multi-task and multi-view learning. We address one such question by presenting a general measure to quantify the success of simultaneous learning of multiple tasks or from multiple views. We show that our SSDR-MML approach can outperform many state-of-the-art baseline methods and demonstrate the effectiveness of connecting dimension reduction and learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑