Documents are central to many business systems, and include forms, reports, contracts, invoices or purchase orders. The information in documents is typically in natural language, but can be organized in various layouts and formats. There have been recent spurt of interest in understanding document content with novel deep learning architectures. However, document understanding tasks need dense information annotations, which are costly to scale and generalize. Several active learning techniques have been proposed to reduce the overall budget of annotation while maintaining the performance of the underlying deep learning model. However, most of these techniques work only for classification problems. But content detection is a more complex task, and has been scarcely explored in active learning literature. In this paper, we propose \textit{OPAD}, a novel framework using reinforcement policy for active learning in content detection tasks for documents. The proposed framework learns the acquisition function to decide the samples to be selected while optimizing performance metrics that the tasks typically have. Furthermore, we extend to weak labelling scenarios to further reduce the cost of annotation significantly. We propose novel rewards to account for class imbalance and user feedback in the annotation interface, to improve the active learning method. We show superior performance of the proposed \textit{OPAD} framework for active learning for various tasks related to document understanding like layout parsing, object detection and named entity recognition. Ablation studies for human feedback and class imbalance rewards are presented, along with a comparison of annotation times for different approaches.
Optimizing Legal Document Retrieval in Vietnamese with Semi-Hard Negative Mining
Faculty of Computer Science, University of Information Technology, Ho Chi Minh City, Vietnam(信息科技学院计算机科学系,胡志明市,越南);Faculty of Information Science and Engineering, University of Information Technology, Ho Chi Minh City, Vietnam(信息科技学院信息科学与工程系,胡志明市,越南);Laboratory of Multimedia Communications, University of Information Technology, Ho Chi Minh City, Vietnam(信息科技学院多媒体通信实验室,胡志明市,越南);Vietnam National University, Ho Chi Minh City, Vietnam(越南国家大学,胡志明市,越南)
NeuroSym-BioCAT: Leveraging Neuro-Symbolic Methods for Biomedical Scholarly Document Categorization and Question Answering
TIB—Leibniz Information Centre for Science and Technology(莱布尼茨科学与技术信息中心(TIB));L3S Research Center, Leibniz University Hannover(汉诺威莱布尼茨大学L3S研究中心);Daffodil International University(水仙国际大学)
Doc-V*:Coarse-to-Fine Interactive Visual Reasoning for Multi-Page Document VQA
School of Software Engineering, Huazhong University of Science and Technology(华中科技大学软件工程学院);MiLM Plus, Xiaomi Inc.(小米公司MiLM Plus团队);School of Computer Science and Technology, Huazhong University of Science and Technology(华中科技大学计算机科学与技术学院);School of Data Science, Fudan University(复旦大学数据科学学院)
Hierarchical Vision-Language Reasoning for Multimodal Multiple-Choice Question Answering
State Key Laboratory for Novel Software Technology, Nanjing University(新型软件技术国家重点实验室,南京大学);Chongqing University of Posts and Telecommunications(重庆邮电大学)
Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrieval
Beijing University of Posts and Telecommunications(北京邮电大学);Microsoft Research Asia(微软亚洲研究院);Microsoft STCA(微软STCA);University of Science and Technology of China(中国科学技术大学)