AudioNet:用于检索相似音频事件的有监督深度哈希
AudioNet: Supervised Deep Hashing for Retrieval of Similar Audio Events
AI总结:
提出有监督深度哈希系统AudioNet,结合加权对比损失、成对损失与哈希码平衡及离散梯度传播优化二进制码,在多标准数据集上实现高效的相似音频事件检索并确立新基线。
摘要:
本研究提出了一种用于检索相似音频事件的有监督深度哈希方法。所提出的方法名为AudioNet,是一个基于深度学习的系统,能够使用音频示例作为查询,高效地哈希并检索相似音频事件。AudioNet通过为相似音频事件生成二进制哈希码,在多个标准数据集上实现了高检索性能,在该领域树立了新的基准,并突显了与其他哈希方法相比的效力与有效性。通过对标准数据集进行综合实验,我们的研究代表了在评估相似音频事件检索性能方面的开创性努力。提出了一种新颖的损失函数,该函数结合了加权对比损失和加权成对损失以及哈希码平衡,以提高音频事件检索的效率。该方法采用离散梯度传播,允许在反向传播期间通过离散变量传播梯度。这使得网络能够使用通常用于连续变量的标准基于梯度的优化算法来优化离散哈希码。实验结果表明,即使在处理不平衡的数据集时,所提出的方法也展现出有前景的检索性能。本研究进行的系统分析进一步支持了所提出的方法在多个数据集检索性能方面的显著优势。本工作的发现为未来使用深度音频嵌入进行相似音频事件高效检索的研究确立了基线。
英文摘要:
This work presents a supervised deep hashing method for retrieving similar audio events. The proposed method, named AudioNet, is a deep-learning-based system for efficient hashing and retrieval of similar audio events using an audio example as a query. AudioNet achieves high retrieval performance on multiple standard datasets by generating binary hash codes for similar audio events, setting new benchmarks in the field, and highlighting its efficacy and effectiveness compare to other hashing methods. Through comprehensive experiments on standard datasets, our research represents a pioneering effort in evaluating the retrieval performance of similar audio events. A novel loss function is proposed which incorporates weighted contrastive and weighted pairwise loss along with hashcode balancing to improve the efficiency of audio event retrieval. The method adopts discrete gradient propagation, which allows gradients to be propagated through discrete variables during backpropagation. This enables the network to optimize the discrete hash codes using standard gradient-based optimization algorithms, which are typically used for continuous variables. The proposed method showcases promising retrieval performance, as evidenced by the experimental results, even when dealing with imbalanced datasets. The systematic analysis conducted in this study further supports the significant benefits of the proposed method in retrieval performance across multiple datasets. The findings presented in this work establish a baseline for future studies on the efficient retrieval of similar audio events using deep audio embeddings.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。