arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.07504cs.MMcs.SI
收藏

网络挖掘COVID-19会话视频日志中的语音线索研究

Exploring Speech Cues in Web-mined COVID-19 Conversational Vlogs

Kexin Feng, Preeti Zanwar, Amir H. Behzadan, Theodora Chaspari

摘要:

由新型SARS冠状病毒2型(n-SARS-CoV-2)引起的COVID-19大流行以前所未有的方式影响了人们的生活。在疫情期间,社交视频博主利用社交媒体积极分享他们在隔离中的意见或经验。本文收集了YouTube上的视频,以跟踪对话视频博客中的情绪反应及其与疫情相关事件的潜在联系。特别是,分析了从纽约市上传的视频日志,因为这是美国大流行的首批震中之一。我们观察到在隔离期间,视频博主的声音和语言特征有一些共同的模式,这表明情绪反应的变化。此外,我们调查了纽约地区与COVID-19事件相关的声学和语言模式的波动(例如每日新增病例数、死亡人数以及居家令和紧急状态的延长)。我们的研究结果表明,声学特征,如过零率,抖动和微光,可以用于分析社交媒体视频中的情感反应。我们的研究结果进一步表明,声学和语言指数的一些峰值与COVID-19事件一致,例如死亡人数和紧急声明的峰值。

英文摘要:

The COVID-19 pandemic caused by the novel SARS-Coronavirus-2 (n-SARS-CoV-2) has impacted people's lives in unprecedented ways. During the time of the pandemic, social vloggers have used social media to actively share their opinions or experiences in quarantine. This paper collected videos from YouTube to track emotional responses in conversational vlogs and their potential associations with events related to the pandemic. In particular, vlogs uploaded from locations in New York City were analyzed given that this was one of the first epicenters of the pandemic in the United States. We observed some common patterns in vloggers' acoustic and linguistic features across the time span of the quarantine, which is indicative of changes in emotional reactivity. Additionally, we investigated fluctuations of acoustic and linguistic patterns in relation to COVID-19 events in the New York area (e.g. the number of daily new cases, number of deaths, and extension of stay-at-home order and state of emergency). Our results indicate that acoustic features, such as zero-crossing-rate, jitter, and shimmer, can be valuable for analyzing emotional reactivity in social media videos. Our findings further indicate that some of the peaks of the acoustic and linguistic indices align with COVID-19 events, such as the peak in the number of deaths and emergency declaration.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑