发表机构
Cornell University; Google(康奈尔大学; 谷歌)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
该研究提出混合电影摄影工作流程,结合移动增强现实应用与离线流程,通过预可视化实时评估生成式视频重拍的幻觉风险,帮助电影人调整拍摄计划以平衡创作意图与生成需求。
AI 中文摘要
在电影拍摄现场,镜头移动是在拍摄过程中确定的。生成式视频重拍让电影人可以在之后更改镜头移动,但这可能需要生成未记录内容的幻觉,这种差距有时直到离开片场后才会被发现。我们提出混合电影摄影(Hybrid Cinematography),这是一种连接物理拍摄与生成式重拍的工作流程,让电影人仍能在现场时管理幻觉风险。通过可编辑的3D拍摄计划和拍摄素材的代理,我们的预可视化工具可实时评估幻觉风险。在发现拍摄素材缺乏支撑的地方,电影人可以迭代调整计划、探索平衡拍摄与生成的移动、拍摄引导补拍,或有意识地接受幻觉。我们通过一款用于现场规划、拍摄和审查的移动增强现实应用,以及针对现有视频的离线流程来演示该工作流程。一项针对资深电影人的研究显示,预可视化风险如何影响镜头决策,并揭示了创作意图与生成式幻觉之间的张力。
英文摘要
On a film set, the camera move is committed during a take. Generative video reshooting lets filmmakers change it afterward, but may require hallucinating unrecorded content, a gap sometimes discovered only after leaving the set. We present Hybrid Cinematography, a workflow that bridges physical capture and generative reshooting to manage hallucination risk while filmmakers can still act on it. Using an editable 3D shot plan and a proxy of the take, our previsualization evaluates hallucination risk in real time. Seeing where the take lacks support, filmmakers can iteratively adjust the plan, explore moves that balance capture and generation, shoot guided pickups, or knowingly accept hallucination. We demonstrate the workflow through a mobile augmented reality application for on-set planning, capture, and review, and an offline pipeline for existing video. A study with experienced filmmakers reveals how previsualizing risk informs camera decisions and exposes tensions between creative intent and generative hallucination.
CommentsProject page: https://hybridcinematography.github.io/