The sheer volume of financial statements makes it difficult for humans to access and analyze a business's financials. Robust numerical reasoning likewise faces unique challenges in this domain. In this work, we focus on answering deep questions over financial data, aiming to automate the analysis of a large corpus of financial documents. In contrast to existing tasks on general domain, the finance domain includes complex numerical reasoning and understanding of heterogeneous representations. To facilitate analytical progress, we propose a new large-scale dataset, FinQA, with Question-Answering pairs over Financial reports, written by financial experts. We also annotate the gold reasoning programs to ensure full explainability. We further introduce baselines and conduct comprehensive experiments in our dataset. The results demonstrate that popular, large, pre-trained models fall far short of expert humans in acquiring finance knowledge and in complex multi-step numerical reasoning on that knowledge. Our dataset -- the first of its kind -- should therefore enable significant, new community research into complex application domains. The dataset and code are publicly available\url{https://github.com/czyssrs/FinQA}.
Document-Level Numerical Reasoning across Single and Multiple Tables in Financial Reports
Department of Computer Science and Information Engineering, National Taiwan University(国立台湾大学资讯工程学系);FinTech Center, National Taiwan University(国立台湾大学金融科技中心)
Knowledge-Augmented Large Language Model Agents for Explainable Financial Decision-Making
Boston University(波士顿大学);Hofstra University(霍夫斯特拉大学);University of Southern California(南加州大学);Georgia Institute of Technology(佐治亚理工学院);Carnegie Mellon University(卡内基梅隆大学)
The University of Edinburgh(爱丁堡大学);University of Aveiro(阿维罗大学);National Technical University of Athens(雅典技术大学);Archimedes/Athena Research Centre(阿基米德/雅典研究中心);The Artificial Intelligence Applications Institute, The University of Edinburgh(人工智能应用研究所,爱丁堡大学)
Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learning
School of Statistics and Data Science, Shanghai University of Finance and Economics, China(上海金融学院统计与数据科学学院,中国);School of Mathematical Sciences, Fudan University, China(复旦大学数学科学学院,中国);School of Economics, Shanghai University of Finance and Economics, China(上海金融学院经济学院,中国);AI Finance Development and Service Center, Shanghai University of Finance and Economics, China(上海金融学院人工智能金融发展与服务中心,中国);QuantaAlpha, China(QuantaAlpha,中国);Department of Statistics, Rice University, USA(里士满大学统计学系,美国);Department of Statistics, London School of Economics and Political Science, UK(伦敦政治经济学院统计学系,英国);Qinghai Provincial Key Laboratory of Big Data in Finance and Artificial Intelligence Application Technology, Qinghai Institute of Technology, China(青海省大数据在金融与人工智能应用技术重点实验室,青海技术学院,中国)
FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation
State Key Laboratory for Multimedia Information Processing, PKU-Anker LLM Lab(多媒体信息处理国家重点实验室,PKU-Anker LLM实验室);School of Computer Science, Peking University(北京大学计算机学院);HKUST(香港科技大学);University of California, Los Angeles(加州大学洛杉矶分校);University of Washington(华盛顿大学)
FinChain: A Symbolic Benchmark for Verifiable Chain-of-Thought Financial Reasoning
MBZUAI;Syllogia;The University of Tokyo(东京大学);The Fin AI(Fin AI);Cornell University(康奈尔大学);The University of Melbourne(墨尔本大学);IIT Delhi(德里理工学院);The University of Manchester(曼彻斯特大学)
APOLLO: An Optimized Training Approach for Long-form Numerical Reasoning
School of Informatics, Xiamen University(厦门大学信息学院);IDEA Research(IDEA研究院);College of Computer Science, Inner Mongolia University(内蒙古大学计算机学院);Microsoft Research Asia(微软亚洲研究院)
FinExam-10K: When Retrieval Helps Financial Reasoning?
Newcastle University(纽卡斯尔大学);University of Manchester(曼彻斯特大学);University of Melbourne(墨尔本大学);University of Aberdeen(阿伯丁大学);University of Groningen(格罗宁根大学);MBZUAI(穆罕默德·本·扎耶德人工智能大学);INSAIT;Sofia University “St. Kliment Ohridski”(索非亚大学“圣·克利门特·奥赫里德斯基”)
What Factors Affect LLMs and RLLMs in Financial Question Answering?
School of Computer Science and Engineering, Macau University of Science and Technology, China(澳门科技大学计算机科学与工程学院);SKLPlanets, Macau University of Science and Technology, China(澳门科技大学月球与行星科学国家重点实验室);School of Economics, Anhui University, China(安徽大学经济学院);School of Energy and Power Engineering, Huazhong University of Science and Technology, China(华中科技大学能源与动力工程学院)
Rethinking Retrieval: From Traditional Retrieval Augmented Generation to Agentic and Non-Vector Reasoning Systems in the Financial Domain for Large Language Models