保持中间目标:一个简单的技巧,以提高层次模型的学习
Preserving Intermediate Objectives: One Simple Trick to Improve Learning for Hierarchical Models
摘要:
层次模型被用于各种各样的问题,其特征在于任务层次结构,其中对较小的子任务的预测对于试图预测最终任务是有用的。通常,神经网络首先针对子任务进行训练,并且这些网络的预测随后在训练模型和对最终任务进行推断时用作附加特征。在这项工作中,我们专注于改进这种分层模型的学习,并展示了我们的说话人特质预测任务的方法。说话人特质预测的目的是通过计算确定说话人可能被认为具有哪些人格特质,并且一直受到人工智能和社会科学界的极大关注。说服力预测特别令人感兴趣,因为有说服力的演讲者对我们的思想,观点和信仰有很大的影响。在这项工作中,我们研究如何利用相关的扬声器特性之间的关系,在一个层次结构,可以帮助提高我们的能力来预测一个扬声器是多么有说服力。我们提出了一种新的算法,使我们能够通过这个层次结构的反向传播。这种分层模型在公开可用的POM数据集上的分类准确性比当前最先进的方法降低了25%的相对误差。
英文摘要:
Hierarchical models are utilized in a wide variety of problems which are characterized by task hierarchies, where predictions on smaller subtasks are useful for trying to predict a final task. Typically, neural networks are first trained for the subtasks, and the predictions of these networks are subsequently used as additional features when training a model and doing inference for a final task. In this work, we focus on improving learning for such hierarchical models and demonstrate our method on the task of speaker trait prediction. Speaker trait prediction aims to computationally identify which personality traits a speaker might be perceived to have, and has been of great interest to both the Artificial Intelligence and Social Science communities. Persuasiveness prediction in particular has been of interest, as persuasive speakers have a large amount of influence on our thoughts, opinions and beliefs. In this work, we examine how leveraging the relationship between related speaker traits in a hierarchical structure can help improve our ability to predict how persuasive a speaker is. We present a novel algorithm that allows us to backpropagate through this hierarchy. This hierarchical model achieves a 25% relative error reduction in classification accuracy over current state-of-the art methods on the publicly available POM dataset.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。