arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.00122cs.CL
收藏

FinQA:一个金融数据的数值推理数据集

FinQA: A Dataset of Numerical Reasoning over Financial Data

University of California, Santa Barbara(加州大学圣巴巴拉分校);J.P. Morgan(摩根大通);Pennsylvania State University(宾夕法尼亚州立大学);Carnegie Mellon University(卡内基梅隆大学)

Zhiyu Chen, Wenhu Chen, Charese Smiley, Sameena Shah, Iana Borova, Dylan Langdon, Reema Moussa, Matt Beane, Ting-Hao Huang, Bryan Routledge, William Yang Wang

摘要:

大量的财务报表使得人们很难访问和分析企业的财务状况。鲁棒数值推理在这一领域同样面临着独特的挑战。在这项工作中,我们专注于回答金融数据的深层问题,旨在自动分析大型金融文档语料库。与一般领域的现有任务相比,金融领域包括复杂的数值推理和对异构表示的理解。为了促进分析的进展,我们提出了一个新的大规模数据集,FinQA,与金融专家撰写的财务报告上的数据对。我们还注释了黄金推理程序,以确保充分的可解释性。我们进一步引入基线,并在我们的数据集中进行全面的实验。结果表明,流行的、大型的、预先训练的模型在获取金融知识和对这些知识进行复杂的多步数值推理方面远远落后于专家。因此,我们的数据集-这是同类数据集中的第一个-应该能够对复杂的应用领域进行重要的新社区研究。数据集和代码是公开的\url{https://github.com/czyssrs/FinQA}。

英文摘要:

The sheer volume of financial statements makes it difficult for humans to access and analyze a business's financials. Robust numerical reasoning likewise faces unique challenges in this domain. In this work, we focus on answering deep questions over financial data, aiming to automate the analysis of a large corpus of financial documents. In contrast to existing tasks on general domain, the finance domain includes complex numerical reasoning and understanding of heterogeneous representations. To facilitate analytical progress, we propose a new large-scale dataset, FinQA, with Question-Answering pairs over Financial reports, written by financial experts. We also annotate the gold reasoning programs to ensure full explainability. We further introduce baselines and conduct comprehensive experiments in our dataset. The results demonstrate that popular, large, pre-trained models fall far short of expert humans in acquiring finance knowledge and in complex multi-step numerical reasoning on that knowledge. Our dataset -- the first of its kind -- should therefore enable significant, new community research into complex application domains. The dataset and code are publicly available\url{https://github.com/czyssrs/FinQA}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑