arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2205.13530cs.LGcs.CL
收藏

页面间关系的语义解析

Semantic Parsing of Interpage Relations

Istanbul Technical University(伊斯坦布尔技术大学);Yapı Kredi Teknoloji(Yapı Kredi科技公司)

Mehmet Arif Demirtaş, Berke Oral, Mehmet Yasin Akpınar, Onur Deniz

摘要:

文档的页面级分析一直是数字化工作中感兴趣的主题,并且多模态方法已被应用于分类和页面流分割。在这项工作中,我们专注于捕捉更精细的多页文档的页面之间的语义关系。为此,我们正式的任务,作为语义解析的页间关系,我们提出了一个端到端的方法进行页间依赖提取,灵感来自依存句法分析文献。我们进一步设计了一个多任务训练方法,以联合优化用于分割,分类和解析页面依赖关系的页面嵌入,使用从页面中提取的文本和视觉特征。此外,我们还结合了两种模态的特征,以获得多模态页面嵌入。据我们所知,这是第一个研究,以提取丰富的语义跨页关系的多页文档。我们的实验结果表明,所提出的方法提高了41个百分点的LAS语义解析,提高了33个百分点的准确性页面流分割,和45个百分点的页面分类在一个天真的基线。

英文摘要:

Page-level analysis of documents has been a topic of interest in digitization efforts, and multimodal approaches have been applied to both classification and page stream segmentation. In this work, we focus on capturing finer semantic relations between pages of a multi-page document. To this end, we formalize the task as semantic parsing of interpage relations and we propose an end-to-end approach for interpage dependency extraction, inspired by the dependency parsing literature. We further design a multi-task training approach to jointly optimize for page embeddings to be used in segmentation, classification, and parsing of the page dependencies using textual and visual features extracted from the pages. Moreover, we also combine the features from two modalities to obtain multimodal page embeddings. To the best of our knowledge, this is the first study to extract rich semantic interpage relations from multi-page documents. Our experimental results show that the proposed method increased LAS by 41 percentage points for semantic parsing, increased accuracy by 33 percentage points for page stream segmentation, and 45 percentage points for page classification over a naive baseline.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑