arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.15196cs.CVcs.AI
收藏

HOTVCOM:为视频生成具有话题性的评论

HOTVCOM: Generating Buzzworthy Comments for Videos

Fudan University(复旦大学);Arizona State University(亚利桑那州立大学);Southern University of Science and Technology(南方科技大学);Ant Group(蚂蚁集团)

Yuyan Chen, Yiwen Qian, Songzhou Yan, Jiyuan Jia, Zhixu Li, Yanghua Xiao, Xiaobo Li, Ming Yang, Qingpei Guo

AI总结:

本文提出最大中文视频热门评论数据集HotVCom及多模态融合框架ComHeat,通过整合视觉、听觉和文本数据生成具有影响力的话题性评论,在多个数据集上验证了其有效性。

摘要:

在社交媒体视频平台时代,热门评论在吸引用户对短视频的印象方面发挥着至关重要的作用,使其成为营销和品牌推广的关键。然而,现有研究主要集中在生成描述性评论或英文弹幕上,仅对特定视频时刻提供即时反应。针对这一空白,本研究引入了HotVCom,这是最大的中文视频热门评论数据集,包含9.4万条多样化视频和1.37亿条评论。我们还提出了ComHeat框架,该框架协同整合视觉、听觉和文本数据,以在中文视频数据集上生成具有影响力的热门评论。实证评估突出了我们框架的有效性,证明了其在新构建和现有数据集上的卓越表现。

英文摘要:

In the era of social media video platforms, popular ``hot-comments'' play a crucial role in attracting user impressions of short-form videos, making them vital for marketing and branding purpose. However, existing research predominantly focuses on generating descriptive comments or ``danmaku'' in English, offering immediate reactions to specific video moments. Addressing this gap, our study introduces \textsc{HotVCom}, the largest Chinese video hot-comment dataset, comprising 94k diverse videos and 137 million comments. We also present the \texttt{ComHeat} framework, which synergistically integrates visual, auditory, and textual data to generate influential hot-comments on the Chinese video dataset. Empirical evaluations highlight the effectiveness of our framework, demonstrating its excellence on both the newly constructed and existing datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑