MixAssist：用于音乐混音协同创作AI辅助的音频-语言数据集
MixAssist: An Audio-Language Dataset for Co-Creative AI Assistance in Music Mixing
AI总结：
MixAssist是一个包含431个音频对话轮次的音频-语言数据集，用于训练AI在音乐混音中提供协同创作辅助，微调Qwen-Audio模型在生成混音建议上表现显著优于其他模型。
摘要：
尽管人工智能在增强音乐混音和母带处理工作流程方面展现出巨大潜力，但当前研究主要侧重于端到端自动化或生成，往往忽视了对于协同创作过程至关重要的协作和教学维度。这一空白使得艺术家，尤其是寻求提升专业技能的非专业人士，未能得到充分的服务。为弥合这一差距，我们引入了MixAssist，一个新颖的音频-语言数据集，捕捉了专家与业余音乐制作人在协作混音会话中的情境化、多轮对话。该数据集包含来自12位制作人参与的7次深度会话中提取的431个基于音频的对话轮次，为训练和评估能够理解并应对现实世界音乐制作对话复杂性的音频-语言模型提供了独特资源。我们的评估，包括自动化的LLM-as-a-judge评估和人类专家比较，表明在MixAssist上对Qwen-Audio等模型进行微调可产生有前景的结果，其中Qwen在生成有用、上下文相关的混音建议方面显著优于其他测试模型。通过聚焦于基于音频情境的协同创作指令，MixAssist使得开发旨在支持和增强音乐混音创作过程的智能AI助手成为可能。
英文摘要：
While AI presents significant potential for enhancing music mixing and mastering workflows, current research predominantly emphasizes end-to-end automation or generation, often overlooking the collaborative and instructional dimensions vital for co-creative processes. This gap leaves artists, particularly amateurs seeking to develop expertise, underserved. To bridge this, we introduce MixAssist, a novel audio-language dataset capturing the situated, multi-turn dialogue between expert and amateur music producers during collaborative mixing sessions. Comprising 431 audio-grounded conversational turns derived from 7 in-depth sessions involving 12 producers, MixAssist provides a unique resource for training and evaluating audio-language models that can comprehend and respond to the complexities of real-world music production dialogues. Our evaluations, including automated LLM-as-a-judge assessments and human expert comparisons, demonstrate that fine-tuning models such as Qwen-Audio on MixAssist can yield promising results, with Qwen significantly outperforming other tested models in generating helpful, contextually relevant mixing advice. By focusing on co-creative instruction grounded in audio context, MixAssist enables the development of intelligent AI assistants designed to support and augment the creative process in music mixing.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
