arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2205.00029cs.CLcs.AIcs.LG
收藏

大规模会话AI中基于反馈的自学习

Self-Aware Feedback-Based Self-Learning in Large-Scale Conversational AI

Amazon Alexa(亚马逊Alexa)

Pragaash Ponnusamy, Clint Solomon Mathialagan, Gustavo Aguilar, Chengyuan Ma, Chenlei Guo

摘要:

大规模会话式人工智能智能体中的自学习范式往往会利用用户反馈来桥接他们所说的和他们所想的。然而,这种学习,特别是在基于马尔可夫的查询重写系统中,还远远没有解决这些模型对未来训练的影响,其中连续的反馈不可避免地取决于重写本身,特别是在不断更新的环境中。在本文中,我们探讨了这种固有的缺乏自我意识的后果,对损害模型的性能,最终导致在I型和II型错误随着时间的推移。为此,我们建议用基于叠加的邻接矩阵来增强马尔可夫图的构建。在这里,我们的方法利用诱导的随机性来基于双变量beta设置中的个体重写的性能来反应性地学习局部自适应决策边界。我们还提出了一种数据增强策略,利用基于模板的生成来简化对话框的复杂会话层次结构,从而简化学习过程。总而言之,我们证明了我们的自我感知模型将整体PR-AUC提高了27.45%,实现了高达31.22%的相对缺陷减少,并且能够更快地适应大量客户的全球偏好变化。

英文摘要:

Self-learning paradigms in large-scale conversational AI agents tend to leverage user feedback in bridging between what they say and what they mean. However, such learning, particularly in Markov-based query rewriting systems have far from addressed the impact of these models on future training where successive feedback is inevitably contingent on the rewrite itself, especially in a continually updating environment. In this paper, we explore the consequences of this inherent lack of self-awareness towards impairing the model performance, ultimately resulting in both Type I and II errors over time. To that end, we propose augmenting the Markov Graph construction with a superposition-based adjacency matrix. Here, our method leverages an induced stochasticity to reactively learn a locally-adaptive decision boundary based on the performance of the individual rewrites in a bi-variate beta setting. We also surface a data augmentation strategy that leverages template-based generation in abridging complex conversation hierarchies of dialogs so as to simplify the learning process. All in all, we demonstrate that our self-aware model improves the overall PR-AUC by 27.45%, achieves a relative defect reduction of up to 31.22%, and is able to adapt quicker to changes in global preferences across a large number of customers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑