AniMaster：通过电影脚本生成与交互式创作从故事文本制作动画视频
AniMaster: From Story Texts to Animated Videos via Cinematic Script Generation and Interactive Authoring
- Hangzhou Dianzi University（杭州电子科技大学）
- Nanyang Technological University（南洋理工大学）
- Zhejiang University（浙江大学）
机构由 AI 辅助整理，请以论文原文为准。
AI总结：
AniMaster是一款VGM驱动的创作工具，通过三层设计框架实现从故事文本到电影脚本再到动画视频的转换，经评估可帮助普通创作者便捷制作精良动画视频。
AI中文摘要：
视频生成模型（VGMs）的最新进展已展现出生成短视频片段的强大能力。然而，对于普通创作者而言，利用这些模型从简短的故事文本制作出精良的长篇动画视频仍然颇具挑战。通过对新手创作者和电影专家开展的一项形式研究，我们明确了交互式视频创作的两大主要挑战：（1）缺乏将自由形式的故事文本转换为专业电影脚本，最终生成高质量动画视频的专业知识；（2）缺乏将视频设计意图传达给视觉叙事关键变量的有效方式，如镜头构图、相机控制和镜头序列。借鉴叙事学和电影研究，我们提出了一个三层设计框架，定义了三个层级（即故事文本、电影脚本和动画视频）的关键设计维度，以及它们之间的转换关系。基于该框架，我们推出了AniMaster，一款由VGM驱动的创作工具，旨在让普通创作者能够轻松地从自由形式的故事文本制作流畅的动画视频。AniMaster会自动将简短的故事文本扩展为详细的电影脚本，并遵循专业视觉叙事原则，进一步将电影脚本转换为精良的视频。它还允许用户通过文本指令和直观交互，对脚本进行交互式编辑并优化生成的视频。我们通过一项包含16名参与者的深度用户研究、两项案例研究以及对2名电影专业人士的专家访谈，对AniMaster进行了广泛评估。结果表明，AniMaster在帮助普通创作者从自由形式的故事文本制作精良动画视频方面具有有效性和可用性。
英文摘要：
Recent advances in Video Generation Models (VGMs) have demonstrated strong capabilities in producing short video clips. However, it is still challenging for everyday creators to leverage these models to produce polished long-form animated videos from brief story texts. Informed by a formative study with both novice creators and film experts, we identify two major challenges of interactive video authoring: (1) the lack of expertise in translating free-form story texts to professional cinematic scripts and finally high-quality animated videos, and (2) the absence of effective ways to convey video design intents to key variables of visual storytelling, such as shot composition, camera controls and shot sequencing. Drawing on narratology and film studies, we propose a three-layer design framework that defines the key design dimensions across three layers (i.e., story texts, cinematic scripts, and animated videos) as well as the translation between them. Built on this framework, we present AniMaster, a VGM-powered authoring tool to enable everyday creators to easily produce smooth animated videos from free-form story texts. AniMaster automatically expands brief story texts to detailed cinematic scripts, and further translates cinematic scripts into polished videos by following professional visual storytelling principles. It also allows users to interactively edit the scripts and refine the generated videos via text instructions and intuitive interactions. We extensively evaluated AniMaster through an in-depth user study with 16 participants, two case studies, and expert interviews with 2 film professionals. The results demonstrate the effectiveness and usability of AniMaster in helping everyday creators create polished animated videos from free-form story texts.
