从文档图像中抽取表格是一项具有挑战性的 AI 问题,而许多内容领域的标注数据难以获得。现有表格抽取数据集通常关注科学表格,因为存在大量易于获取的学术论文及其源代码。然而,科学、金融和其他领域中的表格在版式和排版方面存在显著差异。当前数据集往往缺少表格中包含的词语及其位置,只能依赖不可靠的 OCR 来抽取这些特征,以训练面向自然语言处理任务的现代机器学习模型。因此,需要一种更通用的标注数据获取方法。我们提出 SynFinTabs,这是一个大规模、带标注的合成金融表格数据集。我们希望生成这些合成表格的方法能够迁移到其他领域。为证明该数据集在训练模型从表格图像中抽取信息方面的有效性,我们构建了 FinTabQA,这是一种在抽取式问答任务上训练的版式大语言模型。我们使用真实世界金融表格测试该模型,将其与最先进的生成式模型进行比较并讨论结果。我们公开发布数据集、模型和数据集生成代码。
英文摘要:
Table extraction from document images is a challenging AI problem, and labelled data for many content domains is difficult to come by. Existing table extraction datasets often focus on scientific tables due to the vast amount of academic articles that are readily available, along with their source code. However, there are significant layout and typographical differences between tables found across scientific, financial, and other domains. Current datasets often lack the words, and their positions, contained within the tables, instead relying on unreliable OCR to extract these features for training modern machine learning models on natural language processing tasks. Therefore, there is a need for a more general method of obtaining labelled data. We present SynFinTabs, a large-scale, labelled dataset of synthetic financial tables. Our hope is that our method of generating these synthetic tables is transferable to other domains. To demonstrate the effectiveness of our dataset in training models to extract information from table images, we create FinTabQA, a layout large language model trained on an extractive question-answering task. We test our model using real-world financial tables and compare it to a state-of-the-art generative model and discuss the results. We make the dataset, model, and dataset generation code publicly available.
FinSage: A Multi-aspect RAG System for Financial Filings Question Answering
1SimpleWay.AI 2McGill University 3University of Toronto 4University of California, Los Angeles 5The Chinese University of Hong Kong 6Duke University 7Universit\'e de Montr\'eal 8Mila - Quebec AI Institute 9Noah's Ark Lab 10CG Matrix Technology Limited;1SimpleWay.AI 2McGill University 3University of Toronto 4University of California, Los Angeles;5The Chinese University of Hong Kong 6Duke University 7Universit\'e de Montr\'eal 8Mila - Quebec AI Institute;9Noah's Ark Lab 10CG Matrix Technology Limited
Accept or Deny? Evaluating LLM Fairness and Performance in Loan Approval across Table-to-Text Serialization Approaches
Saarland University(萨尔兰大学);CISPA Helmholtz Center for Information Security(CISPA海德堡中心 for 信息安全);Max Planck Institute for Software Systems(马克斯·普朗克软件系统研究所)
本文评估三种地区贷款审批数据在不同表到文本序列化方式下的 LLM 零样本与 ICL 表现,发现格式显著影响 F1 与公平性。
Evaluating utility in synthetic banking microdata applications
Business School, University of Edinburgh(爱丁堡大学商学院);Central Bank of Paraguay(巴拉圭中央银行);Centre for Statistics, University of Edinburgh(爱丁堡大学统计中心);Centre for Financial Innovations, University of Edinburgh(爱丁堡大学金融创新中心)