arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.03375cs.SDcs.AIcs.IReess.AS
收藏

SoundSignature:你喜欢什么类型的音乐?

SoundSignature: What Type of Music Do You Like?

New York University(纽约大学)

Brandon James Carone, Pablo Ripollés

AI总结:

SoundSignature 将 MIR 与 OpenAI Assistant 结合,通过聊天交互为用户提供个性化音乐声学分析和教育功能,并集成开源音乐处理工具,经试点研究验证其有效性与可用性。

摘要:

SoundSignature 是一款音乐应用,它集成了一个定制的 OpenAI Assistant 来分析用户最喜欢的歌曲。该系统整合了最先进的音乐信息检索(MIR)Python 包,将提取的声学/音乐特征与该助手对艺术家和乐队的广泛知识相结合。利用这种结合的知识,SoundSignature 借助语义音频和新兴的声音互联网(Internet of Sounds, IoS)生态系统的原理,将 MIR 与 AI 集成,为用户提供关于其音乐声学特性的个性化见解,类似于一份音乐偏好个性报告。用户随后可以与聊天机器人互动,深入探究已执行的声学分析及其与自身音乐品味的关系。这种交互性改变了该应用的性质,使其不仅作为熟悉和/或喜爱歌曲的信息资源,还作为一个教育平台,使用户能够加深对音乐特征、音乐理论、信号处理中常用的声学特性以及音乐背后艺术家的理解。除了通用可用性之外,该应用还整合了多个成熟的面向音乐家的开源工具,例如和弦识别算法(CREMA)、音源分离算法(DEMUCS)和音频转 MIDI 转换器(basic-pitch)。这些功能使没有编程技能的用户只需与聊天机器人交互(例如,“你能给我这首歌的分轨吗?”)即可使用先进的开源音乐处理算法。在本文中,我们重点介绍了该应用的创新功能和教育潜力,并展示了一项评估其有效性和可用性的试点用户研究的结果。

英文摘要:

SoundSignature is a music application that integrates a custom OpenAI Assistant to analyze users' favorite songs. The system incorporates state-of-the-art Music Information Retrieval (MIR) Python packages to combine extracted acoustic/musical features with the assistant's extensive knowledge of the artists and bands. Capitalizing on this combined knowledge, SoundSignature leverages semantic audio and principles from the emerging Internet of Sounds (IoS) ecosystem, integrating MIR with AI to provide users with personalized insights into the acoustic properties of their music, akin to a musical preference personality report. Users can then interact with the chatbot to explore deeper inquiries about the acoustic analyses performed and how they relate to their musical taste. This interactivity transforms the application, acting not only as an informative resource about familiar and/or favorite songs, but also as an educational platform that enables users to deepen their understanding of musical features, music theory, acoustic properties commonly used in signal processing, and the artists behind the music. Beyond general usability, the application also incorporates several well-established open-source musician-specific tools, such as a chord recognition algorithm (CREMA), a source separation algorithm (DEMUCS), and an audio-to-MIDI converter (basic-pitch). These features allow users without coding skills to access advanced, open-source music processing algorithms simply by interacting with the chatbot (e.g., can you give me the stems of this song?). In this paper, we highlight the application's innovative features and educational potential, and present findings from a pilot user study that evaluates its efficacy and usability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑