arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.02747cs.CVcs.CL

WhyAct: Identifying Action Reasons in Lifestyle Vlogs

University of Michigan(密歇根大学)

Oana Ignat, Santiago Castro, Hanwen Miao, Weiji Li, Rada Mihalcea

英文摘要:

We aim to automatically identify human action reasons in online videos. We focus on the widespread genre of lifestyle vlogs, in which people perform actions while verbally describing them. We introduce and make publicly available the WhyAct dataset, consisting of 1,077 visual actions manually annotated with their reasons. We describe a multimodal model that leverages visual and textual information to automatically infer the reasons corresponding to an action presented in the video.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑