Communication technologies like voice over IP operate under constrained real-time conditions, with voice packets being subject to delays and losses from the network. In such cases, the packet loss concealment (PLC) algorithm reconstructs missing frames until a new real packet is received. Recently, autoregressive deep neural networks have been shown to surpass the quality of signal processing methods for PLC, specially for long-term predictions beyond 60 ms. In this work, we propose a non-autoregressive adversarial auto-encoder, named PLAAE, to perform real-time PLC in the waveform domain. PLAAE has a causal convolutional structure, and it learns in an auto-encoder fashion to reconstruct signals with gaps, with the help of an adversarial loss. During inference, it is able to predict smooth and coherent continuations of such gaps in a single feed-forward step, as opposed to autoregressive models. Our evaluation highlights the superiority of PLAAE over two classic PLCs and two deep autoregressive models in terms of spectral and intonation reconstruction, perceptual quality, and intelligibility.
A Neural Vocoder Based Packet Loss Concealment Algorithm
Beijing University of Technology(北京工业大学)
IP语音(Voice over IP,VoIP)环境中的丢包问题严重影响了VoIP的服务质量。在本文中,我们研究了基于在线接收器的数据包丢失隐藏,这是更便携和适用。为了保证语音的自然度,该算法不需要直接对时域波形进行处理或在频域分别进行幅值和相位重构,而是采用基于流的神经声码器,由设计良好的神经预测器根据历史语音内容生成Mel-谱图,生成丢失包的替代波形。此外,一个基于波形相似性的平滑后处理被创建,以减轻语音的不连续性和避免的伪影。实验结果表明了该方法的优越性能。