arXiv 2504.082962025-04-11cs.CV

面向电影创作的生成式人工智能：近期进展综述

Generative AI for Film Creation: A Survey of Recent Advances

Google（谷歌）；University of California, Santa Barbara（加利福尼亚大学圣巴巴拉分校）；MYStudio；Harvard University（哈佛大学）；Reality Hack；SUNY Buffalo（纽约州立大学布法罗分校）；Onceness；University of Southampton（南安普顿大学）；New York University（纽约大学）；Communication University of China（中国传媒大学）；University of Southern California（南加利福尼亚大学）；Dodge College of Film and Media Arts（道奇电影与媒体艺术学院）；Pratt Institute（普拉特学院）；Rubyspot；MIT（麻省理工学院）；Netflix（网飞）；Hong Kong University of Science and Technology（香港科技大学）

Ruihan Zhang, Borou Yu, Jiajian Min, Yetong Xin, Zheng Wei, Juncheng Nemo Shi, Mingzhen Huang, Xianghao Kong, Nix Liu Xin, Shanshan Jiang, Praagya Bahuguna, Mar… 展开作者

Ruihan Zhang, Borou Yu, Jiajian Min, Yetong Xin, Zheng Wei, Juncheng Nemo Shi, Mingzhen Huang, Xianghao Kong, Nix Liu Xin, Shanshan Jiang, Praagya Bahuguna, Mark Chan, Khushi Hora, Lijian Yang, Yongqi Liang, Runhe Bian, Yunlei Liu, Isabela Campillo Valencia, Patricia Morales Tredinick, Ilia Kozlov, Sijia Jiang, Peiwen Huang, Na Chen, Xuanxuan Liu, Anyi Rao

备注：: Accepted at CVPR 2025 CVEU workshop: AI for Creative Visual Content Generation Editing and Understanding

阅读 PDF

arXiv 页面 ↗HTML 原文 ↗

AI总结：

本文综述了生成式人工智能在电影创作中的最新进展，分析其在角色、风格、叙事中的应用及一致性、可控性等挑战，并为研究者与艺术家提供发展路线图。

摘要：

生成式人工智能（GenAI）正在变革电影制作，为艺术家提供了文本到图像和图像到视频扩散、神经辐射场、虚拟化身生成以及三维合成等工具。本文考察了这些技术在电影制作中的应用情况，分析近期由人工智能驱动的影片的工作流程，以理解GenAI如何助力角色创作、美学风格化和叙事。我们探讨了保持角色一致性、实现风格连贯性以及确保运动连续性的关键策略。此外，我们着重指出了新兴趋势，例如三维生成日益广泛的应用，以及真实素材与人工智能生成元素的融合。除技术进步之外，我们还考察了GenAI如何促成新的艺术表达，从生成难以拍摄的镜头到梦幻般的基于扩散的变形效果、抽象视觉和非现实物体。我们还收集了艺术家关于挑战和期望改进的反馈，包括一致性、可控性、细粒度编辑和运动细化。我们的研究为人工智能与电影制作不断演进的交叉领域提供了见解，并为在这一快速扩展领域中探索的研究者和艺术家提供了一份路线图。

英文摘要：

Generative AI (GenAI) is transforming filmmaking, equipping artists with tools like text-to-image and image-to-video diffusion, neural radiance fields, avatar generation, and 3D synthesis. This paper examines the adoption of these technologies in filmmaking, analyzing workflows from recent AI-driven films to understand how GenAI contributes to character creation, aesthetic styling, and narration. We explore key strategies for maintaining character consistency, achieving stylistic coherence, and ensuring motion continuity. Additionally, we highlight emerging trends such as the growing use of 3D generation and the integration of real footage with AI-generated elements. Beyond technical advancements, we examine how GenAI is enabling new artistic expressions, from generating hard-to-shoot footage to dreamlike diffusion-based morphing effects, abstract visuals, and unworldly objects. We also gather artists' feedback on challenges and desired improvements, including consistency, controllability, fine-grained editing, and motion refinement. Our study provides insights into the evolving intersection of AI and filmmaking, offering a roadmap for researchers and artists navigating this rapidly expanding field.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。