arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.15379eess.AScs.LGcs.SD

LiveAnon:基于编解码器语言模型的流式说话人匿名化,提升隐私保护与效用

LiveAnon: Improving Privacy and Utility in Streaming Speaker Anonymization with Codec Language Models

Seoul National University(首尔大学)

Yejin Kim, Kyungsu Kim, Seungu Han, Kyogu Lee

AI总结:

本文提出LiveAnon流式说话人匿名化系统,通过受限RVQ解码降低延迟,在VPC24、VPC26数据集上实现了良好的隐私-效用平衡,优于多数基线系统。

摘要:

说话人匿名化(SA)旨在隐藏说话人身份,同时保留语言内容与情感,但现有流式系统常因离散内容瓶颈丢失情感信息,或需针对情感进行特定建模。本文提出LiveAnon,一种基于语音转换的流式SA系统,直接以预训练流式ASR编码器的隐藏特征为条件,对自回归编解码器语言模型进行建模,无需情感特定监督即可保留情感。为降低编解码器生成延迟,本文引入受限残差向量量化(RVQ)解码,该方法在保留粗码本间依赖关系的同时并行预测其余码本。在VPC24数据集上,LiveAnon相比强基线流式SA系统固定目标Stream-Voice-Anon(SVA)提升了可懂度与情感保留度,在情感保留度上与情感提示SVA相当,且在流式系统中实现了最强的半知情隐私保护;在VPC26数据集上,其在所有评估的匿名化系统的各项指标中排名第二,展现出出色的隐私-效用平衡。

英文摘要:

Speaker anonymization (SA) aims to conceal speaker identity while preserving linguistic content and emotion, but existing streaming systems often lose emotion information through discrete content bottlenecks or require emotion-specific modeling. We present LiveAnon, a voice-conversion-based streaming SA system that directly conditions an autoregressive codec language model on hidden features from a pretrained streaming ASR encoder, preserving emotion without emotion-specific supervision. To reduce codec-generation latency, we introduce capped RVQ decoding, which preserves dependencies among coarse codebooks while predicting the remaining codebooks in parallel. Under VPC24, LiveAnon improves intelligibility and emotion preservation over fixed-target Stream-Voice-Anon (SVA), a strong prior streaming SA system, matches emotion-prompted SVA in emotion preservation, and achieves the strongest semi-informed privacy among streaming systems. Under VPC26, it ranks second across all metrics among the evaluated anonymization systems, demonstrating a strong privacy-utility balance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑