arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1908.11404cs.LGstat.ML
收藏

商业口语个人助理中领域分类的主动学习

Active Learning for Domain Classification in a Commercial Spoken Personal Assistant

Apple Inc.(苹果公司)

Xi C. Chen, Adithya Sagar, Justine T. Kao, Tony Y. Li, Christopher Klein, Stephen Pulman, Ashish Garg, Jason D. Williams

摘要:

我们描述了一种用于为我们的个人助理系统的基于LSTM的域选择组件选择相关新训练数据的方法。为任何ML系统添加更多注释的训练数据通常会提高准确性,但前提是它提供了现有数据中尚未充分覆盖的示例。然而,获取、选择和标记相关数据是昂贵的。这项工作提出了一个简单的技术,自动识别新的有用的例子适合人类注释。我们的实验结果表明,该方法相比,随机选择和基于熵的方法,导致更高的准确性提高给定的固定注释预算。虽然该技术是在商业智能助手的环境中开发和测试的,但它具有更广泛的适用性。

英文摘要:

We describe a method for selecting relevant new training data for the LSTM-based domain selection component of our personal assistant system. Adding more annotated training data for any ML system typically improves accuracy, but only if it provides examples not already adequately covered in the existing data. However, obtaining, selecting, and labeling relevant data is expensive. This work presents a simple technique that automatically identifies new helpful examples suitable for human annotation. Our experimental results show that the proposed method, compared with random-selection and entropy-based methods, leads to higher accuracy improvements given a fixed annotation budget. Although developed and tested in the setting of a commercial intelligent assistant, the technique is of wider applicability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑