SophiaPop:流行音乐上的人机协作实验
SophiaPop: Experiments in Human-AI Collaboration on Popular Music
摘要:
一个由工程师、艺术家和算法组成的多元化团队通过各种神经网络、机器人技术和艺术工具合作为SophiaPop创作歌曲,并在机器人名人和动画角色Sophia the Robot上制作动画。索菲亚是一个艺术,研究和其他用途的平台。为了推进索菲亚的艺术和技术,我们将各种人工智能与她作为流行歌星的蓬勃发展的职业生涯的虚构叙述相结合。她的实际人工智能生成的流行歌词,音乐和绘画,以及动画对话,其中她与人类实时互动,讨论她的经历。为了创作音乐,SophiaPop团队从人类和人工智能生成的Sophia角色个性内容以及流行音乐歌曲形式中构建了语料库,以训练并为许多人工智能算法提供种子,包括专家模型和定制训练的Transformer神经网络,然后生成原始的流行歌曲歌词和旋律。我们的音乐家包括Frankie Storm,Adam Pickrell和Tiger Darrow,然后对AI生成的音乐内容进行了解释,包括唱歌和乐器。然后,人类表演的歌唱数据由基于神经网络的Sophia语音处理,该语音是由Cereproc根据人类表演进行定制训练的。然后,这个人工智能生成了索菲亚演唱歌曲的独特声音。然后,我们使用各种动画生成器和人工生成的动画,让索菲亚在音乐视频中演唱歌曲。作为算法和人类,SophiaPop代表了人类与AI的合作,渴望实现人类AI的共生。我们相信,这种多学科的创造性融合与人类和人工智能的共同努力,可以使人工智能以新的和令人兴奋的方式与人类文化相关,并为人类与人工智能关系的未来带来充满希望的愿景。
英文摘要:
A diverse team of engineers, artists, and algorithms, collaborated to create songs for SophiaPop, via various neural networks, robotics technologies, and artistic tools, and animated the results on Sophia the Robot, a robotic celebrity and animated character. Sophia is a platform for arts, research, and other uses. To advance the art and technology of Sophia, we combine various AI with a fictional narrative of her burgeoning career as a popstar. Her actual AI-generated pop lyrics, music, and paintings, and animated conversations wherein she interacts with humans real-time in narratives that discuss her experiences. To compose the music, SophiaPop team built corpora from human and AI-generated Sophia character personality content, along with pop music song forms, to train and provide seeds for a number of AI algorithms including expert models, and custom-trained transformer neural networks, which then generated original pop-song lyrics and melodies. Our musicians including Frankie Storm, Adam Pickrell, and Tiger Darrow, then performed interpretations of the AI-generated musical content, including singing and instrumentation. The human-performed singing data then was processed by a neural-network-based Sophia voice, which was custom-trained from human performances by Cereproc. This AI then generated the unique Sophia voice singing of the songs. Then we animated Sophia to sing the songs in music videos, using a variety of animation generators and human-generated animations. Being algorithms and humans, working together, SophiaPop represents a human-AI collaboration, aspiring toward human AI symbiosis. We believe that such a creative convergence of multiple disciplines with humans and AI working together, can make AI relevant to human culture in new and exciting ways, and lead to a hopeful vision for the future of human-AI relations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。