Exploring Large Language Models for Financial Applications: Techniques, Performance, and Challenges with FinMA
Lyman Briggs College, Michigan State University(密歇根州立大学Lyman Briggs学院);Department of Finance, Michigan State University(密歇根州立大学金融系);African Institute for Mathematical Sciences, Rwanda(刚果(金)数学科学研究所)
This research explores the strengths and weaknesses of domain-adapted Large Language Models (LLMs) in the context of financial natural language processing (NLP). The analysis centers on FinMA, a model created within the PIXIU framework, which is evaluated for its performance in specialized financial tasks. Recognizing the critical demands of accuracy, reliability, and domain adaptation in financial applications, this study examines FinMA's model architecture, its instruction tuning process utilizing the Financial Instruction Tuning (FIT) dataset, and its evaluation under the FLARE benchmark. Findings indicate that FinMA performs well in sentiment analysis and classification, but faces notable challenges in tasks involving numerical reasoning, entity recognition, and summarization. This work aims to advance the understanding of how financial LLMs can be effectively designed and evaluated to assist in finance-related decision-making processes.
Dólares or Dollars? Unraveling the Bilingual Prowess of Financial LLMs Between Spanish and English
The Fin AI;University of Manchester(曼彻斯特大学);School of Computer Science Sichuan University(四川大学计算机学院);School of Computer Science Wuhan University(武汉大学计算机学院);University of Florida(佛罗里达大学);Columbia University(哥伦比亚大学)
针对西班牙语金融NLP研究不足的问题,提出首个双语框架Toisón de Oro,构建指令数据集与评估基准,并推出FinMA-ES模型,在西班牙语金融任务中超越GPT-4等SOTA模型。
Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Models
IDEA Research(IDEA研究机构);The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));The Hong Kong University of Science and Technology(香港科学与技术大学);Nanjing University(南京大学);South China Normal University(华南师范大学);DataArcTech Ltd.(DataArcTech有限公司)
Exploring the Impact of Corpus Diversity on Financial Pretrained Language Models
Department of Applied Artificial Intelligence, Hanyang University(应用人工智能系,翰阳大学);Division of Computer Science, Hanyang University(计算机科学系,翰阳大学);Ramply Inc.(Ramply公司)
Deriving Strategic Market Insights with Large Language Models: A Benchmark for Forward Counterfactual Generation
National University of Singapore(新加坡国立大学);Massachusetts Institute of Technology(麻省理工学院);Nanyang Technological University(南洋理工大学);Indian Institute of Technology, Jodhpur(印度理工学院焦特布尔分校)
Survive at All Costs: Exploring LLM's Risky Behaviors under Survival Pressure
The Conversational AI (CoAI) group, DCST, Tsinghua University(清华大学智能对话AI小组,DCST,清华大学);China Unicom Software Research Institute(中国联合软件研究所);University of Electronic Science and Technology of China(电子科技大学);Institute for Network Sciences and Cyberspace, Tsinghua University(清华大学网络科学与网络空间研究院)