arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.12046eess.AScs.SD
收藏

结合事件共现的图拉普拉斯正则化声音事件检测

Sound Event Detection Utilizing Graph Laplacian Regularization with Event Co-occurrence

Ritsumeikan University(立命馆大学);University of Kitakyusyu(北九州市立大学)

Keisuke Imoto, Seisuke Kyochi

AI总结:

针对声学场景中声音事件常共现的特点,提出结合事件共现图拉普拉斯正则化的声音事件检测方法,在多个公开数据集上较传统方法显著提升了检测性能,尤其对共现事件检测更准确。

摘要:

声学场景中出现的声音事件类型数量有限,且部分声音事件往往会在场景中共现,例如“餐具碰撞(dishes)”和“玻璃叮当声(glass jingling)”这两种声音事件很可能在“烹饪”声学场景中共现。本文提出一种考虑声音事件共现性、采用图拉普拉斯正则化的声音事件检测方法。在该方法中,声音事件的出现情况被表示为一张图,图的节点代表事件发生的频率,边代表声音事件的共现关系。随后将该图表示用于声音事件检测的模型训练,训练过程在包含正则化项的目标函数下优化,该正则化项考虑了声音事件发生与共现的图结构。使用TUT Sound Events 2016、2017数据集以及TUT Acoustic Scenes 2016数据集开展的评估实验表明,在基于片段的F1值指标上,所提方法相较于传统的基于CNN-BiGRU的检测方法,将声音事件检测性能提升了7.9个百分点。实验结果尤其表明,所提方法相比传统方法能够更准确地检测共现的声音事件。

英文摘要:

A limited number of types of sound event occur in an acoustic scene and some sound events tend to co-occur in the scene; for example, the sound events "dishes" and "glass jingling" are likely to co-occur in the acoustic scene "cooking". In this paper, we propose a method of sound event detection using graph Laplacian regularization with sound event co-occurrence taken into account. In the proposed method, the occurrences of sound events are expressed as a graph whose nodes indicate the frequencies of event occurrence and whose edges indicate the sound event co-occurrences. This graph representation is then utilized for the model training of sound event detection, which is optimized under an objective function with a regularization term considering the graph structure of sound event occurrence and co-occurrence. Evaluation experiments using the TUT Sound Events 2016 and 2017 detasets, and the TUT Acoustic Scenes 2016 dataset show that the proposed method improves the performance of sound event detection by 7.9 percentage points compared with the conventional CNN-BiGRU-based detection method in terms of the segment-based F1 score. In particular, the experimental results indicate that the proposed method enables the detection of co-occurring sound events more accurately than the conventional method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑