arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.06073cs.CLcs.SDeess.AS

LightCAM:一种基于上下文感知掩码的D-TDNN的快速轻量级实现

LightCAM: A Fast and Light Implementation of Context-Aware Masking based D-TDNN for Speaker Verification

Zhejiang University of Technology(浙江工业大学);Hangzhou Jet-voice Technology Co., Ltd.(杭州捷声技术有限公司)

Di Cao, Xianchen Wang, Junfeng Zhou, Jiakai Zhang, Yanjing Lei, Wenpeng Chen

AI总结:

针对TDNN计算复杂度高的问题,提出轻量级模型LightCAM,结合DSM和MFA优化D-TDNN,在VoxCeleb上取得更优性能且降低计算成本。

摘要:

传统时延神经网络(TDNN)以高计算复杂度和较慢的推理速度为代价取得了最先进的性能,使其难以在工业环境中实现。带有上下文感知掩码(CAM)模块的密集连接时延神经网络(D-TDNN)已被证明是降低复杂度同时保持系统性能的有效结构。本文提出了一种快速轻量级模型LightCAM,它进一步采用深度可分离卷积模块(DSM),并使用多尺度特征聚合(MFA)进行不同层次的特征融合。在VoxCeleb数据集上进行了大量实验,比较结果表明,它在VoxCeleb1-O上取得了0.83的EER和0.0891的MinDCF,优于其他主流说话人验证方法。此外,复杂度分析进一步表明,所提出的架构具有更低的计算成本和更快的推理速度。

英文摘要:

Traditional Time Delay Neural Networks (TDNN) have achieved state-of-the-art performance at the cost of high computational complexity and slower inference speed, making them difficult to implement in an industrial environment. The Densely Connected Time Delay Neural Network (D-TDNN) with Context Aware Masking (CAM) module has proven to be an efficient structure to reduce complexity while maintaining system performance. In this paper, we propose a fast and lightweight model, LightCAM, which further adopts a depthwise separable convolution module (DSM) and uses multi-scale feature aggregation (MFA) for feature fusion at different levels. Extensive experiments are conducted on VoxCeleb dataset, the comparative results show that it has achieved an EER of 0.83 and MinDCF of 0.0891 in VoxCeleb1-O, which outperforms the other mainstream speaker verification methods. In addition, complexity analysis further demonstrates that the proposed architecture has lower computational cost and faster inference speed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑