AlphaPilot:用于自适应阿尔法挖掘的多轮使用工具的大语言模型智能体,结合强化学习
AlphaPilot: Multi-Turn Tool-Using LLM Agents for Adaptive Alpha Mining with Reinforcement Learning
AI总结:
AlphaPilot是结合强化学习的多轮使用工具的LLM智能体框架,用于自适应阿尔法挖掘,在CSI300和CSI500回测中表现优于其他方法,获最高平均总收益、夏普比率与RankIC
摘要:
公式化阿尔法挖掘旨在寻找可解释的表达式,用于对资产的未来收益进行排序。该任务颇具挑战性,因为它需要同时处理非结构化的市场描述、历史数据以及对候选因子的定量评估,然而大多数现有方法仅利用了其中部分信号。我们提出AlphaPilot,这是一个强化学习框架,用于训练多轮使用工具的大语言模型(LLM)智能体以进行自适应阿尔法挖掘。该智能体以市场描述为条件,提出因子表达式,查询真实数据评估器的反馈,并在多轮过程中更新保留的因子池。这种设计共同利用了市场文本、LLM的金融知识、真实数据以及评估反馈。在推理阶段,AlphaPilot执行逐日搜索和池更新,以适应不断变化的市场机制。在针对沪深300(CSI300)和沪深500(CSI500)的样本外滚动回测的三次独立运行中,AlphaPilot分别实现了42.93%和54.19%的平均总收益,以及2.46和2.86的平均夏普比率。在两个 universe( universe 指投资 universe,即可投资资产集合)上,它在所有评估方法中均取得了最高的平均总收益、夏普比率以及RankIC(信息系数排名)。
英文摘要:
Formulaic alpha mining seeks interpretable expressions that rank assets by future returns. The task is challenging because it demands simultaneous processing of unstructured market descriptions, historical data, and quantitative evaluation of candidate factors, yet most existing methods exploit only a subset of these signals. We introduce AlphaPilot, a reinforcement-learning framework that trains multi-turn tool-using LLM agents for adaptive alpha mining. The agent conditions on market descriptions, proposes factor expressions, queries real-data evaluator feedback, and updates a retained factor pool across turns. This design jointly leverages market text, LLM financial knowledge, real data, and evaluation feedback. At inference time, AlphaPilot performs day-by-day search and pool updates to adapt to shifting market regimes. Across three independent runs in out-of-sample rolling backtests on CSI300 and CSI500, AlphaPilot achieves mean total returns of 42.93% and 54.19%, with mean Sharpe ratios of 2.46 and 2.86, respectively. It attains the highest mean total return, Sharpe, and RankIC among the evaluated methods on both universes.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。