arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.09747q-fin.CPcs.LG
收藏

NIFTY财经新闻标题数据集

NIFTY Financial News Headlines Dataset

University of Toronto(多伦多大学);University of Guelph(圭尔夫大学);Dalhousie University(达尔豪斯大学)

Raeid Saqur, Ken Kato, Nicholas Vinden, Frank Rudzicz

AI总结:

本研究公开了NIFTY财经新闻标题数据集,含适配监督微调和对齐方法的两个版本,提供高质量带元数据的去重新闻标题,并验证了其在股价预测等任务中的应用,助力LLM金融市场预测研究。

摘要:

我们推出并公开NIFTY财经新闻标题数据集,旨在推动和促进利用大语言模型(LLM)开展金融市场预测的研究。该数据集包含两个针对不同建模方法定制的独立版本:(i)NIFTY-LM,面向LLM的监督微调(SFT),采用自回归因果语言建模目标;(ii)NIFTY-RL,专门为对齐方法(如基于人类反馈的强化学习(RLHF))设计,通过拒绝采样和奖励建模实现LLM对齐。每个版本的数据集都提供经过筛选的高质量数据,包含全面的元数据、市场指数以及经过系统过滤和排序、适配现代LLM框架的去重财经新闻标题。我们还开展了实验,展示该数据集在股价走势预测、LLM嵌入在信息获取/丰富度中的作用等任务中的部分应用。NIFTY数据集及相关工具(如系统截断提示上下文长度的工具)已在Hugging Face上发布,网址为https://huggingface.co/datasets/raeidsaqur/NIFTY。

英文摘要:

We introduce and make publicly available the NIFTY Financial News Headlines dataset, designed to facilitate and advance research in financial market forecasting using large language models (LLMs). This dataset comprises two distinct versions tailored for different modeling approaches: (i) NIFTY-LM, which targets supervised fine-tuning (SFT) of LLMs with an auto-regressive, causal language-modeling objective, and (ii) NIFTY-RL, formatted specifically for alignment methods (like reinforcement learning from human feedback (RLHF)) to align LLMs via rejection sampling and reward modeling. Each dataset version provides curated, high-quality data incorporating comprehensive metadata, market indices, and deduplicated financial news headlines systematically filtered and ranked to suit modern LLM frameworks. We also include experiments demonstrating some applications of the dataset in tasks like stock price movement and the role of LLM embeddings in information acquisition/richness. The NIFTY dataset along with utilities (like truncating prompt's context length systematically) are available on Hugging Face at https://huggingface.co/datasets/raeidsaqur/NIFTY.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑