以无声的方式:AI与即兴音乐家超越声音的交流
In a Silent Way: Communication Between AI and Improvising Musicians Beyond Sound
摘要:
协作是建立在信任的基础上的,当决策过程或驱动其行为的内部状态没有暴露时,与创造性的人工智能建立信任是困难的。当人类音乐家一起即兴创作时,一些额外的音乐线索被用来增强音乐交流,并暴露影响音乐决策和合作有效性的精神或情绪状态。我们开发了一个协作即兴的AI鼓手,通过基于表情的可视化来传达其信心。人工智能接受了音乐表演数据以及音乐家与专业鼓手即兴表演的实时皮肤电导的训练,暴露了音乐和音乐外的线索,以告知其生成过程。有经验的即兴音乐家进行了测试的真实和虚假的价值观的单向和双向的音乐外的沟通。每种情况都使用FSS-2问卷进行评估,作为音乐参与的代表。结果表明,机器内部状态的音乐外交流与人类的音乐参与之间存在正相关关系。
英文摘要:
Collaboration is built on trust, and establishing trust with a creative Artificial Intelligence is difficult when the decision process or internal state driving its behaviour isn't exposed. When human musicians improvise together, a number of extra-musical cues are used to augment musical communication and expose mental or emotional states which affect musical decisions and the effectiveness of the collaboration. We developed a collaborative improvising AI drummer that communicates its confidence through an emoticon-based visualisation. The AI was trained on musical performance data, as well as real-time skin conductance, of musicians improvising with professional drummers, exposing both musical and extra-musical cues to inform its generative process. Uni- and bi-directional extra-musical communication with real and false values were tested by experienced improvising musicians. Each condition was evaluated using the FSS-2 questionnaire, as a proxy for musical engagement. The results show a positive correlation between extra-musical communication of machine internal state and human musical engagement.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。