arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09183cs.LGq-bio.BM
收藏

面向可合成药物设计的量子启发式强化学习

Quantum-inspired Reinforcement Learning for Synthesizable Drug Design

Rensselaer Polytechnic Institute (RPI)(伦斯勒理工学院);University of Illinois Urbana-Champaign (UIUC)(伊利诺伊大学厄巴纳-香槟分校);Stanford University(斯坦福大学);Virginia Tech(弗吉尼亚理工大学)

Dannong Wang, Jintai Chen, Zhiding Liang, Tianfan Fu, Xiao-Yang Liu

AI总结:

针对药物发现中可合成分子设计现有方法多依赖随机搜索的问题,提出结合量子启发模拟退火策略神经网络、确定性REINFORCE算法与遗传算法局部搜索的强化学习方法,在PMO基准1万查询预算下性能优于现有最优遗传算法方法。

摘要:

可合成分子设计(又称可合成分子优化)是药物发现中的基础问题,其任务是设计新型分子结构,在确保合成可行性的同时,依据药物相关的评估函数(即目标函数)提升分子属性。然而现有方法大多基于随机搜索。为解决这一问题,本文提出一种新方法,采用带量子启发模拟退火策略神经网络的强化学习方法,智能地在广阔的化学结构离散空间中进行搜索。具体而言,我们使用确定性REINFORCE算法,通过策略神经网络输出转移概率以引导状态转移,并在每次迭代中结合遗传算法进行局部搜索,将解优化至局部最优。我们在Practical Molecular Optimization(PMO,实用分子优化)基准框架下,以1万次查询为预算对方法进行了评估。通过与当前最优的基于遗传算法的方法对比,进一步验证了本文方法具备竞争力的性能。

英文摘要:

Synthesizable molecular design (also known as synthesizable molecular optimization) is a fundamental problem in drug discovery, and involves designing novel molecular structures to improve their properties according to drug-relevant oracle functions (i.e., objective) while ensuring synthetic feasibility. However, existing methods are mostly based on random search. To address this issue, in this paper, we introduce a novel approach using the reinforcement learning method with quantum-inspired simulated annealing policy neural network to navigate the vast discrete space of chemical structures intelligently. Specifically, we employ a deterministic REINFORCE algorithm using policy neural networks to output transitional probability to guide state transitions and local search using genetic algorithm to refine solutions to a local optimum within each iteration. Our methods are evaluated with the Practical Molecular Optimization (PMO) benchmark framework with a 10K query budget. We further showcase the competitive performance of our method by comparing it against the state-of-the-art genetic algorithms-based method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑