arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1807.06792cs.CL
收藏

行为句子嵌入的无监督在线多任务学习

Unsupervised Online Multitask Learning of Behavioral Sentence Embeddings

Shao-Yen Tseng, Brian Baucom, Panayiotis Georgiou

摘要:

无监督学习已经成为一种很有吸引力的方法,可以从大量的未标记数据中轻松获得有意义的数据表示。这些表示或嵌入通常在许多任务中产生优异的结果,无论是直接使用还是作为后续训练阶段的特征。然而,嵌入的质量高度依赖于未标记数据中的假设知识以及系统如何在没有监督的情况下提取信息。领域可移植性在无监督学习中也非常有限,通常需要在其他领域内语料库上重新训练以实现鲁棒性。在这项工作中,我们提出了一个多任务范式的无监督上下文学习的行为互动,解决无监督域适应。我们将在线多任务目标引入到无监督学习中,并表明通过此过程生成的句子嵌入提高了情感任务的性能。

英文摘要:

Unsupervised learning has been an attractive method for easily deriving meaningful data representations from vast amounts of unlabeled data. These representations, or embeddings, often yield superior results in many tasks, whether used directly or as features in subsequent training stages. However, the quality of the embeddings is highly dependent on the assumed knowledge in the unlabeled data and how the system extracts information without supervision. Domain portability is also very limited in unsupervised learning, often requiring re-training on other in-domain corpora to achieve robustness. In this work we present a multitask paradigm for unsupervised contextual learning of behavioral interactions which addresses unsupervised domain adaption. We introduce an online multitask objective into unsupervised learning and show that sentence embeddings generated through this process increases performance of affective tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑