Large language models (LLMs) have become powerful tools for advancing natural language processing applications in the financial industry. However, existing financial LLMs often face challenges such as hallucinations or superficial parameter training, resulting in suboptimal performance, particularly in financial computing and machine reading comprehension (MRC). To address these issues, we propose a novel large language model specifically designed for the Chinese financial domain, named SNFinLLM. SNFinLLM excels in domain-specific tasks such as answering questions, summarizing financial research reports, analyzing sentiment, and executing financial calculations. We then perform the supervised fine-tuning (SFT) to enhance the model's proficiency across various financial domains. Specifically, we gather extensive financial data and create a high-quality instruction dataset composed of news articles, professional papers, and research reports of finance domain. Utilizing both domain-specific and general datasets, we proceed with continuous pre-training on an established open-source base model, resulting in SNFinLLM-base. Following this, we engage in supervised fine-tuning (SFT) to bolster the model's capability across multiple financial tasks. Crucially, we employ a straightforward Direct Preference Optimization (DPO) method to better align the model with human preferences. Extensive experiments conducted on finance benchmarks and our evaluation dataset demonstrate that SNFinLLM markedly outperforms other state-of-the-art financial language models. For more details, check out our demo video here: https://www.youtube.com/watch?v=GYT-65HZwus.
CAPE: A Chinese Dataset for Appraisal-based Emotional Generation using Large Language Models
International Digital Economy Academy (IDEA)(国际数字经济学院(IDEA));University of Michigan(密歇根大学);Hong Kong University of Science and Technology(香港科技大学);University of California, Los Angeles(加州大学洛杉矶分校)
C-VARC: A Large-Scale Chinese Value Rule Corpus for Value Alignment of Large Language Models
BrainCog Lab, Institute of Automation, Chinese Academy of Sciences, Beijing, China(中国科学院自动化研究所脑认知实验室,北京,中国);Beijing Key Laboratory of Safe AI and Superalignment, Beijing, China(北京安全人工智能与超对齐关键实验室,北京,中国);Beijing Institute of AI Safety and Governance, Beijing, China(北京人工智能安全与治理研究所,北京,中国);The School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China(中国科学院大学人工智能学院,北京,中国);Long-term AI, Beijing, China(长期人工智能,北京,中国)
TCM-5CEval: Extended Deep Evaluation Benchmark for LLM's Comprehensive Clinical Research Competence in Traditional Chinese Medicine
School of Artificial Intelligence in Traditional Chinese Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China(上海中医药大学人工智能学院);Shanghai Artificial Intelligence Laboratory, Shanghai, China(上海人工智能实验室);University of Washington, Seattle, Washington, US(华盛顿大学)
Huazhong University of Science and Technology(华中科技大学);University of Copenhagen(哥本哈根大学);University of Electronic Science and Technology of China(电子科技大学);Saarland University(萨尔兰大学)
Legal Rule Induction: Towards Generalizable Principle Discovery from Analogous Judicial Precedents
Department of Computer Science and Engineering, HKUST, Hong Kong SAR, China(香港科技大学计算机科学与工程系);School of Law, Tsinghua University, Beijing, China(清华大学法学院)
Beyond BFI: The CSI for Enhanced Reliability and Validity in Evaluating LLM Personality Traits
University of Illinois Chicago(伊利诺伊大学芝加哥分校);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Microsoft Research Asia(微软亚洲研究院);North Carolina State University(北卡罗来纳州立大学)
Characterizing Multi-Domain False News and Underlying User Effects on Chinese Weibo
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Arizona State University(亚利桑那州立大学);Illinois Institute of Technology(伊利诺伊理工学院)
DimStance: Multilingual Datasets for Dimensional Stance Analysis
University of Göttingen(弗赖堡大学);Yuan Ze University(元智大学);Imperial College London(伦敦帝国理工学院);University of Pretoria(南非普里蒂亚大学);National Yang Ming Chiao Tung University;Maseno University(马斯诺大学);Central Police University Taiwan(台湾中央警察大学);Yunnan University(云南大学);Bayero University Kano(卡诺巴耶罗大学);National Research Council Canada(加拿大国家研究委员会)