arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.07023cs.HCcs.AI
收藏

MR4MR:混合现实中的旋律转世

MR4MR: Mixed Reality for Melody Reincarnation

Atsuya Kobayashi, Ryogo Ishino, Ryuku Nobusue, Takumi Inoue, Keisuke Okazaki, Shoma Sawa, Nao Tokui

AI总结:

MR4MR通过混合现实技术,让用户通过与周围环境的互动生成并转世旋律,探索音乐与空间的互动体验。

摘要:

在探索音乐元素与周围实体和空间关系的历史中,如具体音乐和环境音乐已有诸多尝试。在计算机音乐和数字艺术领域,也设计了关注周围物体和物理空间的互动体验。近年来,随着设备的发展和普及,越来越多的作品在扩展现实(XR)中被设计出来,以创造此类音乐体验。本文描述了MR4MR,一个声音装置作品,使用户能够在混合现实(MR)环境下体验由与周围空间互动产生的旋律。使用HoloLens这种MR头戴式显示器,用户可以将发出声音的虚拟物体撞向周围的真实物体。然后,通过持续生成旋律,跟随物体发出的声音,并使用音乐生成机器学习模型随机和逐渐改变旋律,用户可以感受到其环境旋律的“转世”。

英文摘要:

There is a long history of an effort made to explore musical elements with the entities and spaces around us, such as musique concrète and ambient music. In the context of computer music and digital art, interactive experiences that concentrate on the surrounding objects and physical spaces have also been designed. In recent years, with the development and popularization of devices, an increasing number of works have been designed in Extended Reality to create such musical experiences. In this paper, we describe MR4MR, a sound installation work that allows users to experience melodies produced from interactions with their surrounding space in the context of Mixed Reality (MR). Using HoloLens, an MR head-mounted display, users can bump virtual objects that emit sound against real objects in their surroundings. Then, by continuously creating a melody following the sound made by the object and re-generating randomly and gradually changing melody using music generation machine learning models, users can feel their ambient melody "reincarnating".

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑