Large language models are increasingly used for financial analysis and investment research, yet systematic evaluation of their financial reasoning capabilities remains limited. In this work, we introduce the AI Financial Intelligence Benchmark (AFIB), a multi-dimensional evaluation framework designed to assess financial analysis capabilities across five dimensions: factual accuracy, analytical completeness, data recency, model consistency, and failure patterns. We evaluate five AI systems: GPT, Gemini, Perplexity, Claude, and SuperInvesting, using a dataset of 95+ structured financial analysis questions derived from real-world equity research tasks. The results reveal substantial differences in performance across models. Within this benchmark setting, SuperInvesting achieves the highest aggregate performance, with an average factual accuracy score of 8.96/10 and the highest completeness score of 56.65/70, while also demonstrating the lowest hallucination rate among evaluated systems. Retrieval-oriented systems such as Perplexity perform strongly on data recency tasks due to live information access but exhibit weaker analytical synthesis and consistency. Overall, the results highlight that financial intelligence in large language models is inherently multi-dimensional, and systems that combine structured financial data access with analytical reasoning capabilities provide the most reliable performance for complex investment research workflows.
FinDeepIndicator: Benchmarking Deep Research Agents in End-to-End Financial Indicator Construction
School of Computing, National University of Singapore(新加坡国立大学计算机学院);China Economics and Management Academy, Central University of Finance and Economics(中央财经大学中国经济与管理研究院);Asian Institute of Digital Finance, National University of Singapore(新加坡国立大学亚洲数字金融研究所);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
FinDABench: Benchmarking Financial Data Analysis Ability of Large Language Models
School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院);Shanghai Institute of AI for Education, East China Normal University(华东师范大学上海人工智能教育研究院);PICC AMC(中国人民保险资产管理公司);Bytedance(字节跳动)
FinTagging: Benchmarking LLMs for Extracting and Structuring Financial Information
Georgia Institute of Technology(佐治亚理工学院);Columbia University(哥伦比亚大学);California State University(加州州立大学);University of Montreal(蒙特利尔大学);Carnegie Mellon University(卡内基梅隆大学);Rensselaer Polytechnic Institute(莱斯利理工学院);The University of Manchester(曼彻斯特大学);Harvard University(哈佛大学)
AlphaForgeBench: Benchmarking End-to-End Trading Strategy Design with Large Language Models
Nanyang Technological University(南洋理工大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Hong Kong Polytechnic University(香港理工大学)
Can LLM Agents Be CFOs? Benchmarking Long-Horizon Resource Allocation in an Uncertain Enterprise Environment
Georgia Institute of Technology(佐治亚理工学院);The Fin AI;Stevens Institute of Technology(史蒂文斯理工学院);Columbia University(哥伦比亚大学);George Mason University(乔治·马歇尔大学);McGill University(麦吉尔大学);Mohamed bin Zayed University of Artificial Intelligence(莫扎大学人工智能学院);California State University, Monterey Bay(加州州立大学蒙特雷湾分校);University of Manchester(曼彻斯特大学);Mila – Quebec Artificial Intelligence Institute(魁北克人工智能研究所);Université de Montréal(蒙特利尔大学)
Recognition Is Not Grounding: Benchmarking Multilingual Financial Evidence Extraction
The Fin AI;University of Manchester(曼彻斯特大学);Georgia Institute of Technology(佐治亚理工学院);New Jersey Institute of Technology(新泽西理工学院);Cardiff University(卡迪夫大学)
Benchmarking Multi-Agent LLM Architectures for Financial Document Processing: A Comparative Study of Orchestration Patterns, Cost-Accuracy Tradeoffs and Production Scaling Strategies
Department of Computer Science and Engineering(计算机科学与工程系);New York University(纽约大学);New York, NY 10012(纽约市NY 10012)
Representation Learning of Limit Order Book: A Comprehensive Study and Benchmarking
Harbin Institute of Technology(哈尔滨工业大学);Guangdong Key Laboratory of Brain-Inspired Intelligent Computation(广东省脑启发智能计算重点实验室);Department of Computer Science and Engineering(计算机科学与工程系);Southern University of Science and Technology(南方科技大学);Department of Statistics and Data Science(统计与数据科学系)
Extraction of Research Objectives, Machine Learning Model Names, and Dataset Names from Academic Papers and Analysis of Their Interrelationships Using LLM and Network Analysis
Aichi Institute of Technology(爱知工业大学);University of Tokyo(东京大学);Hokkaido University(北海道大学);Nagaoka University of Technology(长冈技术科学大学);Saitama University(埼玉大学)
Agentic Trading: When LLM Agents Meet Financial Markets
College of Electronic and Information Engineering, Shenzhen University, Shenzhen, China(深圳大学电子与信息工程学院);Shenzhen Audencia Financial Technology Institute, Shenzhen University, Guangdong, People's Republic of China(深圳大学审计金融科技研究所)
QuantBench: Benchmarking AI Methods for Quantitative Investment
The Hong Kong University of Science and Technology(香港科学与技术大学);IDEA Research(IDEA研究院);The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Beijing Institute of Technology(北京理工大学)
Benchmarking is Broken -- Don't Let AI be its Own Judge
Princeton University(普林斯顿大学);CISPA Helmholtz Center for Information Security(CISPA海德堡信息安全中心);Michigan State University(密歇根州立大学);Ohio State University(俄亥俄州立大学);Brown University(布朗大学);Massachusetts Institute of Technology(麻省理工学院);University of California, Los Angeles(加州大学洛杉矶分校);University of Tübingen(图宾根大学);Old Dominion University(旧 Dominion 大学);Technical University of Munich(慕尼黑技术大学);Cornell University(康奈尔大学);Forest AI(森林AI)