贝叶斯风险CTC:序列到序列任务中的可控CTC比对
Bayes risk CTC: Controllable CTC alignment in Sequence-to-Sequence tasks
摘要:
序列到序列(seq2seq)任务将输入序列转录为目标序列。连接主义时间分类(CTC)标准被广泛用于多个seq2seq任务。除了预测靶序列之外,CTC的副产品是预测比对,其是指定输入和靶单元之间的硬比对关系的最可能的长输入序列。由于存在在CTC制定中同等考虑的多个潜在比对序列(称为路径),因此选择哪条路径将最有可能并成为预测比对总是不确定的。此外,通常观察到vanilla CTC预测的比对与其参考相比会漂移,并且很少提供实际功能。因此,这项工作的动机是使CTC比对预测可控,从而为CTC提供额外的功能。贝叶斯风险CTC(BRCTC)的标准,然后提出了这项工作中,其中一个可定制的贝叶斯风险函数是通过执行所需的特性的预测对齐。通过风险函数,BRCTC是一个通用框架,用于对路径采用一些可定制的偏好,以便将后验集中到路径的特定子集中。在应用中,我们探索了一种特定的偏好,它产生具有下采样能力和降低推理成本的模型。通过使用BRCTC与另一种偏好的早期排放,我们获得了改进的性能延迟权衡在线模型。在实验中,所提出的BRCTC将离线模型的推理成本降低了47%,而不会降低性能,并将在线系统的整体延迟降低到一个看不见的水平。
英文摘要:
Sequence-to-Sequence (seq2seq) tasks transcribe the input sequence to a target sequence. The Connectionist Temporal Classification (CTC) criterion is widely used in multiple seq2seq tasks. Besides predicting the target sequence, a side product of CTC is to predict the alignment, which is the most probable input-long sequence that specifies a hard aligning relationship between the input and target units. As there are multiple potential aligning sequences (called paths) that are equally considered in CTC formulation, the choice of which path will be most probable and become the predicted alignment is always uncertain. In addition, it is usually observed that the alignment predicted by vanilla CTC will drift compared with its reference and rarely provides practical functionalities. Thus, the motivation of this work is to make the CTC alignment prediction controllable and thus equip CTC with extra functionalities. The Bayes risk CTC (BRCTC) criterion is then proposed in this work, in which a customizable Bayes risk function is adopted to enforce the desired characteristics of the predicted alignment. With the risk function, the BRCTC is a general framework to adopt some customizable preference over the paths in order to concentrate the posterior into a particular subset of the paths. In applications, we explore one particular preference which yields models with the down-sampling ability and reduced inference costs. By using BRCTC with another preference for early emissions, we obtain an improved performance-latency trade-off for online models. Experimentally, the proposed BRCTC reduces the inference cost of offline models by up to 47% without performance degradation and cuts down the overall latency of online systems to an unseen level.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。