Tables organize valuable content in a concise and compact representation. This content is extremely valuable for systems such as search engines, Knowledge Graph's, etc, since they enhance their predictive capabilities. Unfortunately, tables come in a large variety of shapes and sizes. Furthermore, they can have complex column/row-header configurations, multiline rows, different variety of separation lines, missing entries, etc. As such, the correct identification of the table-structure from an image is a non-trivial task. In this paper, we present a new table-structure identification model. The latter improves the latest end-to-end deep learning model (i.e. encoder-dual-decoder from PubTabNet) in two significant ways. First, we introduce a new object detection decoder for table-cells. In this way, we can obtain the content of the table-cells from programmatic PDF's directly from the PDF source and avoid the training of the custom OCR decoders. This architectural change leads to more accurate table-content extraction and allows us to tackle non-english tables. Second, we replace the LSTM decoders with transformer based decoders. This upgrade improves significantly the previous state-of-the-art tree-editing-distance-score (TEDS) from 91% to 98.5% on simple tables and from 88.7% to 95% on complex tables.
TSRFormer: Table Structure Recognition with Transformers
Microsoft Research Asia(微软亚洲研究院);University of Chinese Academy of Sciences(中国科学院大学);CASIA(中国科学院自动化研究所);University of Science and Technology of China(中国科学技术大学);Shanghai Jiao Tong University(上海交通大学)
Robust Table Structure Recognition with Dynamic Queries Enhanced Detection Transformer
University of Science and Technology of China(中国科学技术大学);Microsoft Research Asia(微软亚洲研究院);Shanghai Jiao Tong University(上海交通大学);University of Chinese Academy of Sciences(中国科学院大学)
Bridging the Performance Gap between DETR and R-CNN for Graphical Object Detection in Document Images
Technical University of Kaiserslautern(凯泽斯劳滕工业大学);German Research Institute for Artificial Intelligence (DFKI)(德国人工智能研究中心);Luleå University of Technology(吕勒奥理工大学)
Towards End-to-End Semi-Supervised Table Detection with Deformable Transformer
Technical University of Kaiserslautern(凯泽斯劳滕工业大学);German Research Institute for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));Luleå University of Technology(吕勒奥理工大学)
Towards End-to-End Semi-Supervised Table Detection with Semantic Aligned Matching Transformer
Technical University of Kaiserslautern(凯泽斯劳滕工业大学);Mindgarage, Technical University of Kaiserslautern(凯泽斯劳滕工业大学Mindgarage);German Research Institute for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI))
LL-ViT: Edge Deployable Vision Transformers with Look Up Table Neurons
Department of Electrical and Computer Engineering, The University of Texas at Austin(电气与计算机工程系,德克萨斯大学奥斯汀分校);The University of Texas at San Antonio(德克萨斯大学圣安东尼奥分校);Federal University of Rio de Janeiro(里约热内卢联邦大学);Instituto de Telecomunicações(电信研究所)
SepFormer: Coarse-to-fine Separator Regression Network for Table Structure Recognition
Data Services Center, Viettel Group, Lot D26 Cau Giay New Urban Area, Cau Giay District, Hanoi, Vietnam Faculty of Computer Science \& Engineering, Ho Chi Minh City University of Technology (HCMUT), VNU-HCM, Ho Chi Minh City, Vietnam