arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2306.12964q-fin.STcs.AIcs.CEcs.LGq-fin.CP
收藏

通过强化学习生成协同公式化Alpha集合

Generating Synergistic Formulaic Alpha Collections via Reinforcement Learning

Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Huawei EI Innovation Lab(华为EI创新实验室);Institute of Intelligent Computing Technology(智能计算技术研究所)

Shuo Yu, Hongyan Xue, Xiang Ao, Feiyang Pan, Jia He, Dandan Tu, Qing He

AI总结:

本文提出一种基于强化学习的Alpha挖掘框架,直接优化下游组合模型性能以生成协同公式化Alpha集合,在真实股市数据上验证了有效性和效率,并实现更高投资回报。

摘要:

在量化交易领域,将原始历史股票数据转换为指示市场趋势的信号是一种常见做法。这类信号被称为Alpha因子。公式形式的Alpha更具可解释性,因此受到关注风险的从业者的青睐。在实践中,一组公式化Alpha常常被联合使用以获得更好的建模精度,因此我们需要找到能够良好协同工作的公式化Alpha集合。然而,大多数传统Alpha生成器是逐个单独挖掘Alpha的,忽视了这些Alpha之后会被组合使用的事实。在本文中,我们提出了一种新的Alpha挖掘框架,优先挖掘协同的Alpha集合,即直接使用下游组合模型的性能来优化Alpha生成器。我们的框架还利用强化学习(RL)的强大探索能力,以更好地探索公式化Alpha的广阔搜索空间。对组合模型性能的贡献被分配为RL过程中使用的回报,驱动Alpha生成器找到能够改进当前集合的更好Alpha。在真实股票市场数据上的实验评估证明了我们框架在股票趋势预测中的有效性和效率。投资模拟结果表明,与之前的方法相比,我们的框架能够实现更高的回报。

英文摘要:

In the field of quantitative trading, it is common practice to transform raw historical stock data into indicative signals for the market trend. Such signals are called alpha factors. Alphas in formula forms are more interpretable and thus favored by practitioners concerned with risk. In practice, a set of formulaic alphas is often used together for better modeling precision, so we need to find synergistic formulaic alpha sets that work well together. However, most traditional alpha generators mine alphas one by one separately, overlooking the fact that the alphas would be combined later. In this paper, we propose a new alpha-mining framework that prioritizes mining a synergistic set of alphas, i.e., it directly uses the performance of the downstream combination model to optimize the alpha generator. Our framework also leverages the strong exploratory capabilities of reinforcement learning~(RL) to better explore the vast search space of formulaic alphas. The contribution to the combination models' performance is assigned to be the return used in the RL process, driving the alpha generator to find better alphas that improve upon the current set. Experimental evaluations on real-world stock market data demonstrate both the effectiveness and the efficiency of our framework for stock trend forecasting. The investment simulation results show that our framework is able to achieve higher returns compared to previous approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑