Soundify:为视频匹配音效
Soundify: Matching Sound Effects to Video
AI总结:
针对视频剪辑中音效匹配难度大的问题,本文提出Soundify系统,可自动识别匹配音效、同步音视频并生成空间音频,实验验证其在多类音效上匹配效果好,能降低剪辑师工作负荷、提升效率与可用性。
摘要:
在视频剪辑艺术中,音效可为物体赋予特质,并让观众获得空间沉浸感。通过对10名专业剪辑师的形成性访谈,我们发现为视频添加音效的任务颇具挑战性。本文提出Soundify系统,用于辅助剪辑师为视频匹配音效。给定一段视频,Soundify会识别匹配的音效,将音效与视频同步,并动态调整声像(panning)和音量以生成空间音频。在一项有889名参与者的人类评估研究中,我们表明Soundify可直接为多种音频类别完成视频与音效的匹配。在一项有12名参与者的被试内专家研究中,我们证明Soundify能帮助视频剪辑师完成音视频匹配任务,降低工作负荷、缩短任务完成时间并提升可用性。
英文摘要:
In the art of video editing, sound helps add character to an object and immerse the viewer within a space. Through formative interviews with professional editors (N=10), we found that the task of adding sounds to video can be challenging. This paper presents Soundify, a system that assists editors in matching sounds to video. Given a video, Soundify identifies matching sounds, synchronizes the sounds to the video, and dynamically adjusts panning and volume to create spatial audio. In a human evaluation study (N=889), we show that Soundify is capable of matching sounds to video out-of-the-box for a diverse range of audio categories. In a within-subjects expert study (N=12), we demonstrate the usefulness of Soundify in helping video editors match sounds to video with lighter workload, reduced task completion time, and improved usability.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。