arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.13908cs.HC
收藏

交互式Rainbow Score:一个以视觉为中心的多模态长笛教学系统

Interactive Rainbow Score: A Visual-centered Multimodal Flute Tutoring System

Daniel Chin, Yian Zhang, Tianyu Zhang, Jake Zhao, Gus G. Xia

摘要:

学习演奏乐器本质上是多模态的,我们已经看到了在音乐游戏和计算机辅助音乐教学系统中应用视觉和触觉反馈的趋势。然而,目前大多数系统仍然是设计来掌握个别的音乐作品;目前还不清楚如何学习技能可以推广到新的作品。我们的目的是探讨这个问题。在这项研究中,我们贡献了互动彩虹分数,一个互动的视觉系统,以促进学习的视觉播放,一般的音乐技能阅读音乐和映射的视觉表征的性能动作。交互式彩虹乐谱的关键设计是将音高(和相应的动作)与彩色符号相关联,并通过实时交互进一步加强这种关联。定量结果表明,交互式功能平均提高了31.1%的学习效率。进一步的分析表明,在学习的早期阶段应用交互是至关重要的。

英文摘要:

Learning to play an instrument is intrinsically multimodal, and we have seen a trend of applying visual and haptic feedback in music games and computer-aided music tutoring systems. However, most current systems are still designed to master individual pieces of music; it is unclear how well the learned skills can be generalized to new pieces. We aim to explore this question. In this study, we contribute Interactive Rainbow Score, an interactive visual system to boost the learning of sight-playing, the general musical skill to read music and map the visual representations to performance motions. The key design of Interactive Rainbow Score is to associate pitches (and the corresponding motions) with colored notation and further strengthen such association via real-time interactions. Quantitative results show that the interactive feature on average increases the learning efficiency by 31.1%. Further analysis indicates that it is critical to apply the interaction in the early period of learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑