arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.02595cs.CVcs.AI
收藏

StageDesigner:基于戏剧剧本的艺术舞台生成

StageDesigner: Artistic Stage Generation for Scenography via Theater Scripts

Fudan University(复旦大学);Shanghai University(上海大学);Shanghai Theatre Academy(上海戏剧学院)

Zhaoxing Gan, Mengtian Li, Ruhua Chen, Zhongxia Ji, Sichen Guo, Huanling Hu, Guangnan Ye, Zuo Hu

AI总结:

本文提出 StageDesigner 框架,结合大语言模型与布局控制的扩散模型,通过剧本分析、前景与背景生成三个模块实现沉浸式 3D 艺术舞台场景生成,并构建 StagePro-V1 数据集验证其有效性。

摘要:

在本研究中,我们提出了 StageDesigner,这是首个结合大语言模型与布局控制的扩散模型,用于艺术舞台生成的综合性框架。鉴于舞台布景的专业要求,StageDesigner 模拟资深艺术家的创作工作流,以生成沉浸式的 3D 舞台场景。具体而言,我们的方法分为三个主要模块:Script Analysis(剧本分析),从输入剧本中提取主题和空间线索;Foreground Generation(前景生成),构建并布置必要的 3D 物体;Background Generation(背景生成),生成与叙事氛围相和谐的背景,并通过管理前景与背景元素之间的遮挡关系来维持空间连贯性。此外,我们引入了 StagePro-V1 数据集,这是一个专门为该任务定制的专用数据集,包含 276 个涵盖不同历史风格的独特舞台场景,并标注了剧本、图像和详细的 3D 布局。最后,使用标准指标和新提出的指标进行的评估,以及广泛的用户研究,证明了 StageDesigner 的有效性。项目地址:https://deadsmither5.github.io/2025/01/03/StageDesigner/

英文摘要:

In this work, we introduce StageDesigner, the first comprehensive framework for artistic stage generation using large language models combined with layout-controlled diffusion models. Given the professional requirements of stage scenography, StageDesigner simulates the workflows of seasoned artists to generate immersive 3D stage scenes. Specifically, our approach is divided into three primary modules: Script Analysis, which extracts thematic and spatial cues from input scripts; Foreground Generation, which constructs and arranges essential 3D objects; and Background Generation, which produces a harmonious background aligned with the narrative atmosphere and maintains spatial coherence by managing occlusions between foreground and background elements. Furthermore, we introduce the StagePro-V1 dataset, a dedicated dataset with 276 unique stage scenes spanning different historical styles and annotated with scripts, images, and detailed 3D layouts, specifically tailored for this task. Finally, evaluations using both standard and newly proposed metrics, along with extensive user studies, demonstrate the effectiveness of StageDesigner. Project can be found at: https://deadsmither5.github.io/2025/01/03/StageDesigner/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑