arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.00465cs.HC
收藏

为视频摘要的个性化配置获取用户偏好

Eliciting User Preferences for Personalized Explanations for Video Summaries

Oana Inel, Nava Tintarev, Lora Aroyo

摘要:

视频摘要或亮点是探索和情境化前所未有的大量视频材料的一个引人注目的替代方案。然而,摘要过程通常是自动的、不透明的,并且可能偏向原始视频中描述的特定方面。因此,我们的目标是帮助档案管理员或收藏管理员等用户快速了解哪些摘要最能代表原始视频。在本文中,我们提出了不同类型的视觉解释的效用,以实现透明度的最终用户的视频摘要的代表性,相对于原始视频的实证结果。我们考虑了四种类型的视频摘要解释,它们以不同的方式使用从原始视频字幕和视频流中提取的概念,以及它们的突出性。解释的生成,以满足目标用户的喜好,并表示不同的层面的透明度:概念的突出性,语义覆盖,距离和覆盖量。在两个用户研究中,我们评估了视觉解释对最终用户实现透明度的实用性。我们的研究结果表明,代表所有维度的解释具有最高的透明度效用,因此,对于理解视频摘要的代表性。

英文摘要:

Video summaries or highlights are a compelling alternative for exploring and contextualizing unprecedented amounts of video material. However, the summarization process is commonly automatic, non-transparent and potentially biased towards particular aspects depicted in the original video. Therefore, our aim is to help users like archivists or collection managers to quickly understand which summaries are the most representative for an original video. In this paper, we present empirical results on the utility of different types of visual explanations to achieve transparency for end users on how representative video summaries are, with respect to the original video. We consider four types of video summary explanations, which use in different ways the concepts extracted from the original video subtitles and the video stream, and their prominence. The explanations are generated to meet target user preferences and express different dimensions of transparency: concept prominence, semantic coverage, distance and quantity of coverage. In two user studies we evaluate the utility of the visual explanations for achieving transparency for end users. Our results show that explanations representing all of the dimensions have the highest utility for transparency, and consequently, for understanding the representativeness of video summaries.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑