面向表格结构识别的优化表格分词方法
Optimized Table Tokenization for Table Structure Recognition
AI总结:
针对表格结构识别中Im2Seq模型的标记表示影响性能的问题,提出优化表格结构语言OTSL,减少标记数与序列长度,提升精度、减半推理时间且消除多数后处理需求。
摘要:
从文档中提取表格是所有文档转换流程中的关键任务。近期,基于transformer的模型已证明,采用图像到标记序列(Image-to-Markup-Sequence, Im2Seq)方法能够以极高的精度识别表格结构。这类模型仅输入表格图像,即可预测代表表格结构的标记序列(如HTML、LaTeX格式)。由于表格结构的标记表示对所有Im2Seq模型的精度和运行时性能有显著影响,本文研究了如何优化表格结构表示。我们提出了一种全新的优化表格结构语言(Optimized Table-Structure Language, OTSL),该语言具备最小化词表和特定规则。OTSL的优势在于将标记数量减少至5个(HTML需要28个以上),并将序列长度平均缩短至HTML的一半。相应地,模型精度显著提升,推理时间较基于HTML的模型减半,且预测的表格结构始终符合语法正确性,进而消除了大多数后处理需求。
英文摘要:
Extracting tables from documents is a crucial task in any document conversion pipeline. Recently, transformer-based models have demonstrated that table-structure can be recognized with impressive accuracy using Image-to-Markup-Sequence (Im2Seq) approaches. Taking only the image of a table, such models predict a sequence of tokens (e.g. in HTML, LaTeX) which represent the structure of the table. Since the token representation of the table structure has a significant impact on the accuracy and run-time performance of any Im2Seq model, we investigate in this paper how table-structure representation can be optimised. We propose a new, optimised table-structure language (OTSL) with a minimized vocabulary and specific rules. The benefits of OTSL are that it reduces the number of tokens to 5 (HTML needs 28+) and shortens the sequence length to half of HTML on average. Consequently, model accuracy improves significantly, inference time is halved compared to HTML-based models, and the predicted table structures are always syntactically correct. This in turn eliminates most post-processing needs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。