arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.02423cs.AI
收藏

RefineShot:通过基础技能评估重新思考电影摄影理解

RefineShot: Rethinking Cinematography Understanding with Foundational Skill Evaluation

University of California, Merced(加州大学梅尔德分校);The University of Queensland(昆士兰大学);vivo Mobile Communication Co., Ltd(vivo移动通信有限公司)

Hang Wu, Yujun Cai, Haonan Ge, Hongkai Chen, Ming-Hsuan Yang, Yiwei Wang

AI总结:

针对现有电影摄影理解基准ShotBench的选项歧义问题及SOTA模型ShotVL的推理缺陷,研究通过重构选项、分析模型推理行为、引入联合评估协议,推出优化扩展的基准RefineShot,提升评估可靠性以推动领域发展。

摘要:

电影摄影理解指的是不仅能够识别场景的视觉内容,还能识别塑造叙事意义的电影技术的能力。这种能力正受到越来越多的关注,因为它增强了现实应用中的多模态理解,并为电影和媒体领域的连贯内容创作提供支撑。作为该任务最全面的基准,ShotBench(镜头基准)涵盖广泛的电影概念和视觉问答(VQA)式评估,ShotVL在该基准上取得了当前最优(SOTA)结果。然而,我们的分析显示,ShotBench中存在歧义的选项设计,以及ShotVL在推理一致性和指令遵循方面的不足,削弱了评估的可靠性,限制了公平比较并阻碍了未来进展。为解决这些问题,我们通过一致的选项重构系统地优化了ShotBench,首次对ShotVL的推理行为进行了批判性分析,并引入了一种联合评估任务准确率和模型核心能力的扩展评估协议。这些工作催生了RefineShot,这是一个经过优化和扩展的基准,能够实现更可靠的评估,并推动电影摄影理解领域的未来发展。

英文摘要:

Cinematography understanding refers to the ability to recognize not only the visual content of a scene but also the cinematic techniques that shape narrative meaning. This capability is attracting increasing attention, as it enhances multimodal understanding in real-world applications and underpins coherent content creation in film and media. As the most comprehensive benchmark for this task, ShotBench spans a wide range of cinematic concepts and VQA-style evaluations, with ShotVL achieving state-of-the-art results on it. However, our analysis reveals that ambiguous option design in ShotBench and ShotVL's shortcomings in reasoning consistency and instruction adherence undermine evaluation reliability, limiting fair comparison and hindering future progress. To overcome these issues, we systematically refine ShotBench through consistent option restructuring, conduct the first critical analysis of ShotVL's reasoning behavior, and introduce an extended evaluation protocol that jointly assesses task accuracy and core model competencies. These efforts lead to RefineShot, a refined and expanded benchmark that enables more reliable assessment and fosters future advances in cinematography understanding.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑