arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.13084cs.CL
收藏

弱监督学习的邮件意图检测

Learning with Weak Supervision for Email Intent Detection

Arizona State University(亚利桑那州立大学);Microsoft Research AI(微软人工智能研究院);Microsoft(微软)

Kai Shu, Subhabrata Mukherjee, Guoqing Zheng, Ahmed Hassan Awadallah, Milad Shokouhi, Susan Dumais

摘要:

电子邮件仍然是最常用的在线通信手段之一。人们每天都在电子邮件上花费大量时间来交换信息,管理任务和安排活动。以前的工作已经研究了不同的方法来提高电子邮件的生产力,通过优先考虑电子邮件,建议自动回复或识别意图,建议适当的行动。这个问题主要是作为一个监督学习问题提出的,其中提出了不同复杂度的模型来将电子邮件消息分类为预定义的意图或类别的分类。对标记数据的需求一直是训练监督模型的最大瓶颈之一。这对于许多现实世界的任务尤其如此,例如电子邮件意图分类,其中由于隐私或数据访问限制,大规模注释的示例难以获取或不可用。电子邮件用户通常响应于电子邮件中表达的意图而采取动作(例如,响应于具有日程安排请求的电子邮件来建立会议)。这样的动作可以从用户交互日志推断。在本文中,我们建议利用用户的行为作为一个来源的弱监督,除了一组有限的注释的例子,检测电子邮件中的意图。我们开发了一个端到端的强大的深度神经网络模型,用于电子邮件意图识别,该模型利用了干净的注释数据和嘈杂的弱监督以及自定进度的学习机制。在三个不同的意图检测任务上的大量实验表明,我们的方法可以有效地利用弱监督数据来提高电子邮件中的意图检测。

英文摘要:

Email remains one of the most frequently used means of online communication. People spend a significant amount of time every day on emails to exchange information, manage tasks and schedule events. Previous work has studied different ways for improving email productivity by prioritizing emails, suggesting automatic replies or identifying intents to recommend appropriate actions. The problem has been mostly posed as a supervised learning problem where models of different complexities were proposed to classify an email message into a predefined taxonomy of intents or classes. The need for labeled data has always been one of the largest bottlenecks in training supervised models. This is especially the case for many real-world tasks, such as email intent classification, where large scale annotated examples are either hard to acquire or unavailable due to privacy or data access constraints. Email users often take actions in response to intents expressed in an email (e.g., setting up a meeting in response to an email with a scheduling request). Such actions can be inferred from user interaction logs. In this paper, we propose to leverage user actions as a source of weak supervision, in addition to a limited set of annotated examples, to detect intents in emails. We develop an end-to-end robust deep neural network model for email intent identification that leverages both clean annotated data and noisy weak supervision along with a self-paced learning mechanism. Extensive experiments on three different intent detection tasks show that our approach can effectively leverage the weakly supervised data to improve intent detection in emails.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑