arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.01889cs.CL
收藏

什么时候该笑,笑到什么程度?一种检测幽默及其强度的多模态方法

When to Laugh and How Hard? A Multimodal Approach to Detecting Humor and its Intensity

University of Helsinki(赫尔辛基大学);Rootroo Oy(Rootroo公司);Aalto University(阿尔托大学)

Khalid Alnajjar, Mika Hämäläinen, Jörg Tiedemann, Jorma Laaksonen, Mikko Kurimo

摘要:

在喜剧电视节目中,预先录制的笑声伴随着对话,通过清楚地标记节目中的幽默时刻来鼓励观众发笑。我们提出了一种使用多模态数据自动检测《老友记》电视节目中幽默的方法。我们的模型能够识别话语是否幽默并评估其强度。我们使用节目中预先录制的笑声作为注释,因为它标志着幽默,观众笑声的长度告诉我们给定的笑话有多有趣。我们在模型在训练阶段没有接触过的事件上评估模型。我们的研究结果表明,该模型是能够正确地检测话语是否是幽默的78%的时间和多长时间的观众的笑声反应应该持续600毫秒的平均绝对误差。

英文摘要:

Prerecorded laughter accompanying dialog in comedy TV shows encourages the audience to laugh by clearly marking humorous moments in the show. We present an approach for automatically detecting humor in the Friends TV show using multimodal data. Our model is capable of recognizing whether an utterance is humorous or not and assess the intensity of it. We use the prerecorded laughter in the show as annotation as it marks humor and the length of the audience's laughter tells us how funny a given joke is. We evaluate the model on episodes the model has not been exposed to during the training phase. Our results show that the model is capable of correctly detecting whether an utterance is humorous 78% of the time and how long the audience's laughter reaction should last with a mean absolute error of 600 milliseconds.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑