arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2608.19350cs.HCcs.SD

MultiVerse:一种以创作者为中心的引导上下文自适应歌词的方法

MultiVerse: A Creator-Centered Approach to Steering Context-Adaptive Lyrics

  • Carnegie Mellon University(卡内基梅隆大学)

机构由 AI 辅助整理,请以论文原文为准。

Alexander Wang, Chris Donahue, David Lindlbauer

AI总结:

针对现有媒体适配系统忽视创作者意图的问题,提出以创作者为中心的MultiVerse系统,通过规则验证实现自适应歌词创作,经10位词曲作者研究验证了其有效性与创作价值。

AI中文摘要:

生成式AI可通过根据消费上下文动态调整媒体内容,实现新型上下文感知的创意表达形式,例如AI系统可根据听众及其当前活动调整歌曲歌词。然而,现有的媒体适配系统主要优化受众体验,往往忽视艺术家的意图、风格和偏好。我们通过引入一种新型的以创作者为中心的自适应媒体创作方法来应对这一挑战,并提出MultiVerse系统,该系统将此方法实例化以引导自适应歌词创作。我们的方法允许创作者基于自身意图、歌词结构和受众上下文明确编写控制规则,并采用基于规则的验证确保控制规则被遵守。我们开展了一项包含10名词曲作者的研究,将MultiVerse与基于提示的自适应歌词创作工作流进行对比。对比显示,创作者更倾向于通过明确指定相关上下文和适配约束来编写歌词的适配方式,同时认识到灵活性与迭代速度之间的权衡。访谈进一步揭示,创作者认为自适应媒体能实现新型受众连接形式、引入独特的创作流程、催生新的创作策略,并重塑作者身份的概念。

英文摘要:

Generative AI may enable new forms of context-aware creative expression by dynamically tailoring media content to its consumption context. For instance, AI systems could adapt song lyrics to the listener and their current activity. However, existing media adaptation systems primarily optimize for audience experience, often neglecting artists' intent, style, and preference. We address this challenge by introducing a novel creator-centered approach to adaptive media authoring and present MultiVerse, a system that instantiates this approach for steering adaptive lyrics. Our approach allows creators to explicitly author controls based on their intent, lyric structure, and audience context, and uses rule-based validations to ensure controls are followed. We conducted a study with 10 songwriters, comparing MultiVerse with a prompting-based workflow for composing adaptive lyrics. The comparison revealed that creators preferred to author how lyrics adapt by explicitly specifying relevant context and adaptation constraints, while recognizing trade-offs in flexibility and iteration speed. Interviews further revealed that creators viewed adaptive media as enabling new forms of audience connection, introducing a distinct creative process, favoring new compositional strategies, and reshaping notions of authorship.

补充信息

↑