arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.20144eess.AScs.SD
收藏

基于距离的单通道目标语音提取

Distance Based Single-Channel Target Speech Extraction

Tokyo Institute of Technology(东京工业大学)

Runwu Shi, Benjamin Yen, Kazuhiro Nakadai

AI总结:

本文首次仅利用距离信息实现单通道目标语音提取,提出高效融合距离信息与时频单元的新模型,并在单房间和多房间场景中验证了其可行性与有效性。

摘要:

本文旨在仅利用距离信息实现封闭空间中的单通道目标语音提取(TSE)。这是首个在不使用说话人生理信息的情况下、仅利用距离线索进行单通道TSE的工作。受近期单通道基于距离的分离与提取方法启发,我们提出了一种新模型,该模型能够高效地将距离信息与时频(TF)单元融合以用于TSE。在单房间和多房间场景下的实验结果表明了该方法的可行性和有效性。该方法还可用于估计混合语音中不同说话人的距离。在线演示可在 https://runwushi.github.io/distance-demo-page 获取。

英文摘要:

This paper aims to achieve single-channel target speech extraction (TSE) in enclosures by solely utilizing distance information. This is the first work that utilizes only distance cues without using speaker physiological information for single-channel TSE. Inspired by recent single-channel Distance-based separation and extraction methods, we introduce a novel model that efficiently fuses distance information with time-frequency (TF) bins for TSE. Experimental results in both single-room and multi-room scenarios demonstrate the feasibility and effectiveness of our approach. This method can also be employed to estimate the distances of different speakers in mixed speech. Online demos are available at https://runwushi.github.io/distance-demo-page.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑