Financial Text Classification Based On rLoRA Finetuning On Qwen3-8B model
LL Funds LLC(LL Funds有限责任公司)
Zhiming Lian
备注:
This paper has been accepted to the 2025 2nd International Conference on Digital Economy and Computer Science (DECS 2025) and is awaiting publication in the ACM International Conference Proceeding Series
Financial text classification has increasingly become an important aspect in quantitative trading systems and related tasks, such as financial sentiment analysis and the classification of financial news. In this paper, we assess the performance of the large language model Qwen3-8B on both tasks. Qwen3-8B is a state-of-the-art model that exhibits strong instruction-following and multilingual capabilities, and is distinct from standard models, primarily because it is specifically optimized for efficient fine tuning and high performance on reasoning-based benchmarks, making it suitable for financial applications. To adapt this model, we apply Noisy Embedding Instruction Finetuning and based on our previous work, this method increases robustness by injecting controlled noise into the embedding layers during supervised adaptation. We improve efficiency further with Rank-stabilized Low-Rank Adaptation low-rank optimization approach, and FlashAttention, which allow for faster training with lower GPU memory. For both tasks, we benchmark Qwen3-8B against standard classical transformer models, such as T5, BERT, and RoBERTa, and large models at scale, such as LLaMA1-7B, LLaMA2-7B, and Baichuan2-7B. The findings reveal that Qwen3-8B consistently surpasses these baselines by obtaining better classification accuracy and needing fewer training epochs. The synergy of instruction-based fine-tuning and memory-efficient optimization methods suggests Qwen3-8B can potentially serve as a scalable, economical option for real-time financial NLP applications. Qwen3-8B provides a very promising base for advancing dynamic quantitative trading systems in the future.
Controlling Text-to-Image Diffusion by Orthogonal Finetuning
MPI for Intelligent Systems(MPI智能系统研究所);University of Tübingen(蒂宾根大学);University of Cambridge(剑桥大学);Mila, Université de Montréal(蒙特利尔大学米拉研究所);Bosch Center for Artificial Intelligence(博世人工智能中心);The Alan Turing Institute(阿兰·图灵研究所)
Refining Few-Step Text-to-Multiview Diffusion via Reinforcement Learning
School of Computer Science, National Engineering Research Center for Multimedia Software and Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University(计算机学院、多媒体软件国家工程研究中心和湖北多媒体与网络通信工程重点实验室、武汉大学);School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学信息科学与技术学院深圳校区);Tencent Inc.(腾讯公司);Xiaomi Inc., China(小米公司,中国)
Characterizing Financial Market Coverage using Artificial Intelligence
LICEF Research Center, Université TÉLUQ(魁北克大学远程教育大学LICEF研究中心);LORIA, Université de Lorraine(洛林大学洛林计算机科学及其应用实验室);Université de Sherbrooke(舍布鲁克大学);Laplace Insights(拉普拉斯洞察公司)