arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.02069cs.IRcs.CL
收藏

OPAD:一个优化的基于策略的主动学习文档内容分析框架

OPAD: An Optimized Policy-based Active Learning Framework for Document Content Analysis

Adobe Research(奥多比研究院);IIT Roorkee(印度理工学院鲁尔基分校)

Sumit Shekhar, Bhanu Prakash Reddy Guda, Ashutosh Chaubey, Ishan Jindal, Avneet Jain

摘要:

文档是许多业务系统的核心,包括表单、报告、合同、发票或采购订单。文档中的信息通常采用自然语言,但可以采用各种布局和格式进行组织。最近,人们对使用新颖的深度学习架构来理解文档内容的兴趣激增。然而,文档理解任务需要密集的信息注释,这对于扩展和概括来说是昂贵的。已经提出了几种主动学习技术来减少注释的总体预算,同时保持底层深度学习模型的性能。然而,这些技术中的大多数仅适用于分类问题。但内容检测是一个更复杂的任务,在主动学习文献中几乎没有探讨。在本文中,我们提出了\textit{OPAD},一个新的框架,使用强化政策的主动学习的内容检测任务的文件。所提出的框架学习的采集功能,以决定要选择的样本,同时优化性能指标,任务通常有。此外,我们扩展到弱标签的情况下,以进一步降低成本的注释显着。我们提出了新的奖励占类的不平衡和用户反馈的注释界面,以改善主动学习方法。我们表现出优越的性能所提出的\textit{OPAD}框架主动学习的各种任务,如布局解析,目标检测和命名实体识别的文档理解。消融研究人类的反馈和类不平衡的奖励,随着注释时间的比较不同的方法。

英文摘要:

Documents are central to many business systems, and include forms, reports, contracts, invoices or purchase orders. The information in documents is typically in natural language, but can be organized in various layouts and formats. There have been recent spurt of interest in understanding document content with novel deep learning architectures. However, document understanding tasks need dense information annotations, which are costly to scale and generalize. Several active learning techniques have been proposed to reduce the overall budget of annotation while maintaining the performance of the underlying deep learning model. However, most of these techniques work only for classification problems. But content detection is a more complex task, and has been scarcely explored in active learning literature. In this paper, we propose \textit{OPAD}, a novel framework using reinforcement policy for active learning in content detection tasks for documents. The proposed framework learns the acquisition function to decide the samples to be selected while optimizing performance metrics that the tasks typically have. Furthermore, we extend to weak labelling scenarios to further reduce the cost of annotation significantly. We propose novel rewards to account for class imbalance and user feedback in the annotation interface, to improve the active learning method. We show superior performance of the proposed \textit{OPAD} framework for active learning for various tasks related to document understanding like layout parsing, object detection and named entity recognition. Ablation studies for human feedback and class imbalance rewards are presented, along with a comparison of annotation times for different approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑