arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1901.01855cs.AI
收藏

投资组合管理的A* 树搜索

A* Tree Search for Portfolio Management

Xiaojie Gao, Shikui Tu, Lei Xu

摘要:

我们提出了一个基于规划的方法教代理从头开始管理投资组合。我们的方法将深度强化学习技术与AlphaGo等搜索技术相结合。结合A* 搜索算法和蒙特卡罗树搜索的优点,提出了一种新的A* 树搜索算法,它返回最佳信息,指导下一次搜索。改进了蒙特卡洛树的扩展方式,提高了神经网络的利用率。该算法还可以通过组合搜索来优化不可微效用函数。这种技术在我们的交易系统中得到了应用。该算法的主要组成部分是一个神经网络,它通过树搜索中的交易经验进行训练,并输出先验概率,通过依次修剪树枝来指导搜索。模拟和真实金融数据的实验结果验证了所提出的交易系统的鲁棒性和交易系统产生更好的策略比基于强化学习的几种方法。

英文摘要:

We propose a planning-based method to teach an agent to manage portfolio from scratch. Our approach combines deep reinforcement learning techniques with search techniques like AlphaGo. By uniting the advantages in A* search algorithm with Monte Carlo tree search, we come up with a new algorithm named A* tree search in which best information is returned to guide next search. Also, the expansion mode of Monte Carlo tree is improved for a higher utilization of the neural network. The suggested algorithm can also optimize non-differentiable utility function by combinatorial search. This technique is then used in our trading system. The major component is a neural network that is trained by trading experiences from tree search and outputs prior probability to guide search by pruning away branches in turn. Experimental results on simulated and real financial data verify the robustness of the proposed trading system and the trading system produces better strategies than several approaches based on reinforcement learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑