面向多任务回归的张量化LSSVM
Tensorized LSSVMs for Multitask Regression
AI总结:
针对多模态数据下多任务回归的结构关联建模问题,提出基于低秩张量分析的tLSSVM-MTL方法,采用CP分解权重张量并设计交替优化算法,实验验证了其性能优势。
摘要:
多任务学习(MTL)可利用多任务间的相关性提升性能。多模态数据的出现使得任务可通过多个索引进行引用。高阶张量能够为此类任务提供高效表示,同时保留结构化的任务关联。本文提出一种新的多任务学习方法,该方法借助低秩张量分析,构建张量化最小二乘支持向量机,即tLSSVM-MTL,可灵活实现多线性建模及其非线性扩展。我们用一个高阶张量表示所有权重,张量的每个模对应一个索引,并采用CP分解对其进行因式分解,为所有任务分配一个共享因子,同时沿每个索引保留任务特定的潜在因子。随后推导了一种用于该非凸优化的交替算法,每个所得子问题均可通过线性系统求解。实验结果表明,本文提出的tLSSVM-MTL具有良好的性能。
英文摘要:
Multitask learning (MTL) can utilize the relatedness between multiple tasks for performance improvement. The advent of multimodal data allows tasks to be referenced by multiple indices. High-order tensors are capable of providing efficient representations for such tasks, while preserving structural task-relations. In this paper, a new MTL method is proposed by leveraging low-rank tensor analysis and constructing tensorized Least Squares Support Vector Machines, namely the tLSSVM-MTL, where multilinear modelling and its nonlinear extensions can be flexibly exerted. We employ a high-order tensor for all the weights with each mode relating to an index and factorize it with CP decomposition, assigning a shared factor for all tasks and retaining task-specific latent factors along each index. Then an alternating algorithm is derived for the nonconvex optimization, where each resulting subproblem is solved by a linear system. Experimental results demonstrate promising performances of our tLSSVM-MTL.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。