arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.05427cs.HCcs.IR
收藏

MelodyVis:乐谱中旋律模式的可视化分析

MelodyVis: Visual Analytics for Melodic Patterns in Sheet Music

Matthias Miller, Daniel Fürst, Maximilian T. Fischer, Hanna Hauptmann, Daniel Keim, Mennatallah El-Assady

AI总结:

MelodyVis 是一个与音乐学专家合作设计的乐谱旋律模式可视化分析系统,通过八个原子算子(如移调、镜像)和五个联动视图支持交互式模式识别,用户研究表明其能显著提升旋律模式的发现与解释能力。

摘要:

手动旋律检测是一项繁琐的任务,需要很高的专业水平,而自动检测往往表现力不足或能力不够强大。因此,我们提出了 MelodyVis,这是一个与音乐学专家合作设计的可视化应用程序,用于探索数字乐谱中的旋律模式。MelodyVis 具有五个相互连接的视图,包括旋律算子图(Melody Operator Graph)和声部时间线(Voicing Timeline)。该系统利用八个原子算子(如移调和镜像)来捕捉旋律的重复与变奏。用户可以通过在乐谱视图中手动选择模式来开始分析,然后通过交互式探索过程,基于所选样本识别其他模式。我们开展了一项用户研究,以调查我们的方法及其集成的旋律算子的有效性和有用性,包括可用性和心理负荷问题。我们比较了 25 名参与者在启用和未启用算子的情况下所执行的分析。研究结果表明,参与者在启用算子的情况下能够识别出至少两倍数量的模式。MelodyVis 允许分析人员引导分析过程并解释结果。我们的研究还证实了 MelodyVis 在支持旋律分析中常见分析任务方面的有用性,参与者报告模式识别和解释能力得到了改善。因此,MelodyVis 解决了全自动方法的局限性,使音乐分析人员能够介入分析过程,发现并理解乐谱中错综复杂的旋律模式和变换。

英文摘要:

Manual melody detection is a tedious task requiring high expertise level, while automatic detection is often not expressive or powerful enough. Thus, we present MelodyVis, a visual application designed in collaboration with musicology experts to explore melodic patterns in digital sheet music. MelodyVis features five connected views, including a Melody Operator Graph and a Voicing Timeline. The system utilizes eight atomic operators, such as transposition and mirroring, to capture melody repetitions and variations. Users can start their analysis by manually selecting patterns in the sheet view, and then identifying other patterns based on the selected samples through an interactive exploration process. We conducted a user study to investigate the effectiveness and usefulness of our approach and its integrated melodic operators, including usability and mental load questions. We compared the analysis executed by 25 participants with and without the operators. The study results indicate that the participants could identify at least twice as many patterns with activated operators. MelodyVis allows analysts to steer the analysis process and interpret results. Our study also confirms the usefulness of MelodyVis in supporting common analytical tasks in melodic analysis, with participants reporting improved pattern identification and interpretation. Thus, MelodyVis addresses the limitations of fully-automated approaches, enabling music analysts to step into the analysis process and uncover and understand intricate melodic patterns and transformations in sheet music.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑