基于条件链映射的混合信号序列到多序列学习
Sequence to Multi-Sequence Learning via Conditional Chain Mapping for Mixture Signals
摘要:
神经序列到序列模型很好地建立了应用程序,可以转换为一个单一的输入序列映射到一个单一的输出序列。在这项工作中,我们专注于一对多的序列转导问题,如从混合序列中提取多个连续的来源。我们将标准的序列到序列模型扩展为条件多序列模型,该模型使用概率链规则显式地对多个输出序列之间的相关性进行建模。基于此扩展,我们的模型可以有条件地推断输出序列一个接一个地利用输入和先前估计的上下文输出序列。该模型还具有用于转导结束的简单且有效的停止标准,使得其能够推断输出序列的可变数量。我们把语音数据作为一个主要的测试领域来评估我们的方法,因为观察到的语音数据往往是由多个来源,由于声波的叠加原理的性质。在语音分离和多说话人语音识别等多个不同任务上的实验表明,我们的条件多序列模型比传统的非条件模型有一致的改进。
英文摘要:
Neural sequence-to-sequence models are well established for applications which can be cast as mapping a single input sequence into a single output sequence. In this work, we focus on one-to-many sequence transduction problems, such as extracting multiple sequential sources from a mixture sequence. We extend the standard sequence-to-sequence model to a conditional multi-sequence model, which explicitly models the relevance between multiple output sequences with the probabilistic chain rule. Based on this extension, our model can conditionally infer output sequences one-by-one by making use of both input and previously-estimated contextual output sequences. This model additionally has a simple and efficient stop criterion for the end of the transduction, making it able to infer the variable number of output sequences. We take speech data as a primary test field to evaluate our methods since the observed speech data is often composed of multiple sources due to the nature of the superposition principle of sound waves. Experiments on several different tasks including speech separation and multi-speaker speech recognition show that our conditional multi-sequence models lead to consistent improvements over the conventional non-conditional models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。