流光相伴:面向音乐视频的AI辅助环境光景创作
Glow with the Flow: AI-Assisted Creation of Ambient Lightscapes for Music Videos
AI总结:
本文提出了一种AI辅助系统,用于生成音乐视频的环境光序列,通过提取视频和音频特征,提供可编辑的初步设计,帮助非专业用户创建设计灯光。
摘要:
设计灯光是一种已建立的现场表演和音乐播放模式。尽管消费者智能照明的可用性不断增加,但为音乐可视化设计灯光仍然局限于专业领域,因为受到时间和技能的限制。为了解决这个问题,我们提出了一种AI辅助系统,用于生成音乐视频的环境光序列。受专业设计启发,该系统从源视频和音频中提取显著特征,生成可编辑的基于对象的环境光效果初步设计。我们通过将系统的自主输出与手工编写的设计进行比较,对系统进行了评估,针对三个音乐视频。32名参与者的反馈结果表明,初始输出为人类作者进一步完善提供了可行的基础。这项工作展示了AI辅助工作流程在支持设计灯光创建和采用方面的效用,超越了专业场所。
英文摘要:
Designed light is an established modality for live performance and music playback. Despite the growing availability of consumer smart lighting, the creation of designed light for music visualization remains limited to professional contexts due to time and skill constraints. To address this, we present an AI-assisted system for generating ambient light sequences for music videos. Informed by professional design heuristics, the system extracts salient features from source video and audio to generate an editable preliminary design of object based ambient light effect. We evaluated the system by comparing its autonomous output against hand-authored designs for three music videos. Findings from responses by 32 participants indicate that the initial output provides a viable baseline for further refinement by human authors. This work demonstrates the utility of AI-assisted workflows in supporting the creation and adoption of designed light beyond professional venues.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。