arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.12629cs.MMcs.CYcs.SI
收藏

电视话语解码:大规模综合多模态分析

Television Discourse Decoded: Comprehensive Multimodal Analytics at Scale

Anmol Agarwal, Pratyush Priyadarshi, Shiven Sinha, Shrey Gupta, Hitkul Jangra, Ponnurangam Kumaraguru, Kiran Garimella

AI总结:

本文针对印度黄金时段电视辩论,提出一个结合计算机视觉与语音转文本的综合自动化工具包,通过大规模多模态分析揭示话题选择、嘉宾代表性方面的显著偏见及严重不文明现象,并公开代码与数据集以推动公共话语质量研究。

摘要:

在本文中,我们处理分析电视辩论的复杂任务,重点关注印度一档黄金时段新闻辩论节目。以往的方法通常仅依赖文本,难以捕捉这些辩论的多模态本质。为弥补这一不足,我们引入了一个综合自动化工具包,该工具包采用先进的计算机视觉和语音转文本技术进行大规模多媒体分析。利用最先进的计算机视觉算法和语音转文本方法,我们对印度一档黄金时段电视辩论节目的数千个YouTube视频进行了转录、说话人分离和分析。这些辩论是印度媒体的核心组成部分,但一直因新闻操守受损和过度戏剧化而受到批评。我们的工具包提供了评估偏见和不文明行为的具体指标,捕捉了包括文本、音频话语和视频帧在内的综合多媒体视角。我们的研究结果揭示了在话题选择和嘉宾代表性方面存在显著偏见,以及令人担忧的不文明程度。这项工作为未来多媒体分析研究提供了一种可扩展的自动化方法,对公共话语质量和民主辩论具有深远影响。为促进该领域的进一步研究,我们还发布了代码、所收集的数据集以及补充PDF。

英文摘要:

In this paper, we tackle the complex task of analyzing televised debates, with a focus on a prime time news debate show from India. Previous methods, which often relied solely on text, fall short in capturing the multimodal essence of these debates. To address this gap, we introduce a comprehensive automated toolkit that employs advanced computer vision and speech-to-text techniques for large-scale multimedia analysis. Utilizing state-of-the-art computer vision algorithms and speech-to-text methods, we transcribe, diarize, and analyze thousands of YouTube videos of a prime-time television debate show in India. These debates are a central part of Indian media but have been criticized for compromised journalistic integrity and excessive dramatization. Our toolkit provides concrete metrics to assess bias and incivility, capturing a comprehensive multimedia perspective that includes text, audio utterances, and video frames. Our findings reveal significant biases in topic selection and panelist representation, along with alarming levels of incivility. This work offers a scalable, automated approach for future research in multimedia analysis, with profound implications for the quality of public discourse and democratic debate. To catalyze further research in this area, we also release the code, dataset collected and supplemental pdf.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑