编排数字画布:一种面向艺术表演的机器学习方法
Choreographing the Digital Canvas: A Machine Learning Approach to Artistic Performance
AI总结:
本文提出一种基于属性描述的艺术表演设计工具,通过循环属性条件变分自编码器(AC-VAE)对跌倒运动进行分阶段学习与生成,并结合交互式网页界面为艺术家提供细粒度运动控制与可视化支持。
摘要:
本文介绍了一种基于属性描述的艺术表演设计工具概念。为此,我们使用了一组特定的跌倒动作表演。该平台将一种新颖的机器学习(ML)模型与交互式界面集成,以生成并可视化艺术动作。我们方法的核心是一个循环的属性条件变分自编码器(AC-VAE)模型,该模型的开发旨在解决从运动捕捉(MoCap)数据中捕获并生成逼真三维人体运动这一挑战。我们创建了一个专注于跌倒运动动态的独特数据集,并以一种新的本体对其进行表征,该本体将运动划分为三个不同阶段:Impact、Glitch 和 Fall。该机器学习模型的创新之处在于其能够分别学习这些阶段。这是通过应用全面的数据增强技术和初始姿态损失函数来实现的,从而生成自然且合理的运动。我们的基于网页的界面为艺术家提供了一个直观的平台来使用该技术,提供对运动属性的细粒度控制以及交互式可视化工具,包括360度视图和用于回放操作的动态时间轴。我们的研究为未来铺平了道路,使技术能够放大人类表达的创造潜力,让更广泛的艺术社区能够使用复杂的运动生成技术。
英文摘要:
This paper introduces the concept of a design tool for artistic performances based on attribute descriptions. To do so, we used a specific performance of falling actions. The platform integrates a novel machine-learning (ML) model with an interactive interface to generate and visualize artistic movements. Our approach's core is a cyclic Attribute-Conditioned Variational Autoencoder (AC-VAE) model developed to address the challenge of capturing and generating realistic 3D human body motions from motion capture (MoCap) data. We created a unique dataset focused on the dynamics of falling movements, characterized by a new ontology that divides motion into three distinct phases: Impact, Glitch, and Fall. The ML model's innovation lies in its ability to learn these phases separately. It is achieved by applying comprehensive data augmentation techniques and an initial pose loss function to generate natural and plausible motion. Our web-based interface provides an intuitive platform for artists to engage with this technology, offering fine-grained control over motion attributes and interactive visualization tools, including a 360-degree view and a dynamic timeline for playback manipulation. Our research paves the way for a future where technology amplifies the creative potential of human expression, making sophisticated motion generation accessible to a wider artistic community.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。