This article details our participation (L3iTC) in the FinLLM Challenge Task 2024, focusing on two key areas: Task 1, financial text classification, and Task 2, financial text summarization. To address these challenges, we fine-tuned several large language models (LLMs) to optimize performance for each task. Specifically, we used 4-bit quantization and LoRA to determine which layers of the LLMs should be trained at a lower precision. This approach not only accelerated the fine-tuning process on the training data provided by the organizers but also enabled us to run the models on low GPU memory. Our fine-tuned models achieved third place for the financial classification task with an F1-score of 0.7543 and secured sixth place in the financial summarization task on the official test datasets.
A Survey of Large Language Models in Finance (FinLLMs)
The University of Sydney（悉尼大学）；NRS Technology（NRS科技公司）；The University of Melbourne（墨尔本大学）；Pohang University of Science and Technology (POSTECH)（浦项科技大学）
Open-FinLLMs: Open Multimodal Large Language Models for Financial Applications
The Fin AI（Fin AI）；Wuhan University（武汉大学）；Columbia University（哥伦比亚大学）；The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；Nanjing University（南京大学）；Rensselaer Polytechnic Institute（罗格斯理工学院）；The University of Manchester（曼彻斯特大学）；Stevens Institute of Technology（史泰斯理工学院）；National University of Singapore（新加坡国立大学）；University of Florida（佛罗里达大学）；University of Montreal（蒙特利尔大学）；Yale University（耶鲁大学）；New York University（纽约大学）；Harvard University（哈佛大学）；NVIDIA（英伟达）；Artificial Intelligence Research Centre（人工智能研究中心）；Archimedes/Athena Research Centre（Archimedes/Athena研究中心）
Are LLMs Rational Investors? A Study on Detecting and Reducing the Financial Bias in LLMs
School of Computer Science, Fudan University（复旦大学计算机科学技术学院）；Institute of Fintech, Fudan University（复旦大学金融科技研究院）；School of Electronics and Information Engineering, Tongji University（同济大学电子与信息工程学院）；Tandon School of Engineering, New York University（纽约大学坦登工程学院）；DataGrand Inc.（数据堂公司）
Exploring Large Language Models for Financial Applications: Techniques, Performance, and Challenges with FinMA
Lyman Briggs College, Michigan State University（密歇根州立大学Lyman Briggs学院）；Department of Finance, Michigan State University（密歇根州立大学金融系）；African Institute for Mathematical Sciences, Rwanda（刚果(金)数学科学研究所）
FinDeepResearch: Evaluating Deep Research Agents in Rigorous Financial Analysis
National University of Singapore（国立新加坡大学）；Estates Pte Ltd（6Estates公司）；Asian Institute of Digital Finance（亚洲数字金融研究所）；Hefei University of Technology（合肥工业大学）；University of Science and Technology of China（中国科学技术大学）
FinSphere, a Real-Time Stock Analysis Agent Powered by Instruction-Tuned LLMs and Domain Tools
JF SmartInvest Holdings Ltd.（JF SmartInvest控股有限公司）；Columbia University（哥伦比亚大学）；Shanghai University of Finance and Economics（上海财经大学）；Johns Hopkins University（约翰霍普金斯大学）
FinBen: A Holistic Financial Benchmark for Large Language Models
The Fin AI；Wuhan University（武汉大学）；Sichuan University（四川大学）；Columbia University（哥伦比亚大学）；Jiangxi Normal University（江西师范大学）；The University of Manchester（曼彻斯特大学）；Stony Brook University（石溪大学）；Stevens Institute of Technology（史蒂文斯理工学院）；Yunnan University（云南大学）；Nanjing Audit University（南京审计大学）；University of Florida（佛罗里达大学）；The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；Southwest Jiaotong University（西南交通大学）
