arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.04173eess.AS
收藏

NPU-NTU 系统用于 2024 年语音隐私挑战赛

NPU-NTU System for Voice Privacy 2024 Challenge

Jixun Yao, Nikita Kuzmin, Qing Wang, Pengcheng Guo, Ziqian Ning, Dake Guo, Kong Aik Lee, Eng-Siong Chng, Lei Xie

AI总结:

本文提出用于 VPC 2024 的说话人匿名化系统,采用解耦神经编解码器与多种蒸馏方法分离语言内容、说话人身份和情感,并通过候选身份加权和随机身份实现匿名化,取得隐私保护与情感保留的最佳平衡。

摘要:

说话人匿名化是一种有效的隐私保护方案,它在保留原始语音的语言内容和副语言信息的同时隐藏说话人身份。为了建立公平的基准并促进说话人匿名化系统的比较,语音隐私挑战赛(VPC)于 2020 年和 2022 年举办,并计划在 2024 年推出新一届。在本文中,我们描述了我们为 VPC 2024 提出的说话人匿名化系统。我们的系统采用解耦神经编解码器架构和串行解耦策略,逐步解耦全局说话人身份与时变的语言内容和副语言信息。我们引入了多种蒸馏方法来解耦语言内容、说话人身份和情感。这些方法包括语义蒸馏、有监督的说话人蒸馏和帧级情感蒸馏。基于这些蒸馏,我们使用一组候选说话人身份的加权和以及随机生成的说话人身份来匿名化原始说话人身份。我们的系统在 VPC 2024 中实现了隐私保护与情感保留之间的最佳权衡。

英文摘要:

Speaker anonymization is an effective privacy protection solution that conceals the speaker's identity while preserving the linguistic content and paralinguistic information of the original speech. To establish a fair benchmark and facilitate comparison of speaker anonymization systems, the VoicePrivacy Challenge (VPC) was held in 2020 and 2022, with a new edition planned for 2024. In this paper, we describe our proposed speaker anonymization system for VPC 2024. Our system employs a disentangled neural codec architecture and a serial disentanglement strategy to gradually disentangle the global speaker identity and time-variant linguistic content and paralinguistic information. We introduce multiple distillation methods to disentangle linguistic content, speaker identity, and emotion. These methods include semantic distillation, supervised speaker distillation, and frame-level emotion distillation. Based on these distillations, we anonymize the original speaker identity using a weighted sum of a set of candidate speaker identities and a randomly generated speaker identity. Our system achieves the best trade-off of privacy protection and emotion preservation in VPC 2024.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑