异步视频面试中的注意片段
Slices of Attention in Asynchronous Video Job Interviews
摘要:
非语言行为在招聘决策中的影响仍然是一个悬而未决的问题。调查这个问题很重要,因为它可以更好地了解如何训练求职者参加面试,并使招聘人员意识到有影响力的非语言行为。由于社会信号自动分析工具的发展和机器学习方法的出现,这项研究最近得到了加速。然而,这些研究仍然主要基于手工设计的特征,这限制了有影响力的社交信号的发现。另一方面,深度学习方法是一种很有前途的工具,可以在不需要特征工程的情况下发现复杂的模式。在本文中,我们专注于研究有影响力的非语言社会信号在异步工作视频面试中发现的深度学习方法。我们使用先前发布的深度学习系统,该系统旨在推断候选人关于一系列面试问题的可操作性。该系统的一个特点是使用了注意力机制,其目的是识别答案的相关部分。因此,在细粒度的时间级别的信息可以提取使用全局(在面试级别)的注释hirability。虽然大多数深度学习系统都使用注意力机制来在注意力上升时提供切片的快速可视化,但我们会进行深入分析,以了解在这些时刻发生了什么。首先,我们提出了一种方法来自动提取切片的注意力(注意力切片)的上升。其次,我们研究了注意切片的内容,通过比较他们与随机抽样切片。最后,我们表明,他们承担显着更多的信息比随机采样切片的hirability。
英文摘要:
The impact of non verbal behaviour in a hiring decision remains an open question. Investigating this question is important, as it could provide a better understanding on how to train candidates for job interviews and make recruiters be aware of influential non verbal behaviour. This research has recently been accelerated due to the development of tools for the automatic analysis of social signals, and the emergence of machine learning methods. However, these studies are still mainly based on hand engineered features, which imposes a limit to the discovery of influential social signals. On the other side, deep learning methods are a promising tool to discover complex patterns without the necessity of feature engineering. In this paper, we focus on studying influential non verbal social signals in asynchronous job video interviews that are discovered by deep learning methods. We use a previously published deep learning system that aims at inferring the hirability of a candidate with regard to a sequence of interview questions. One particularity of this system is the use of attention mechanisms, which aim at identifying the relevant parts of an answer. Thus, information at a fine-grained temporal level could be extracted using global (at the interview level) annotations on hirability. While most of the deep learning systems use attention mechanisms to offer a quick visualization of slices when a rise of attention occurs, we perform an in-depth analysis to understand what happens during these moments. First, we propose a methodology to automatically extract slices where there is a rise of attention (attention slices). Second, we study the content of attention slices by comparing them with randomly sampled slices. Finally, we show that they bear significantly more information for hirability than randomly sampled slices.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。