arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.10557cond-mat.mtrl-sci
收藏

延迟报酬的学习--二维材料缺陷反设计的实例研究

Learning with Delayed Rewards -- A case study on inverse defect design in 2D materials

Suvo Banik, Troy D Loeffler, Rohit Batra, Harpal Singh, Mathew Cherukara, Subramanian KRS Sankaranarayanan

摘要:

材料中的缺陷动力学对于从催化到储能系统再到微电子学的广泛技术具有核心重要性。材料的功能在很大程度上取决于缺陷的性质和组织,它们的排列通常涉及中间或瞬态,这些状态对转化具有很高的障碍。缺乏知识的这些中间状态和存在这种能量障碍提出了一个严重的挑战,反缺陷设计,特别是基于梯度的方法。在这里,我们提出了一个强化学习(蒙特卡洛树搜索)的基础上延迟奖励,允许有效搜索的缺陷配置空间,并允许我们确定低维材料中的最佳缺陷排列。使用一个有代表性的情况下,二维MoS 2,我们证明了延迟奖励的使用,使我们能够有效地采样的缺陷配置空间,并克服了能量障碍的缺陷浓度范围很广(从1.5%到8%的S空位),该系统从一个初始的随机分布的S空位发展到一个扩展的S线缺陷与以前的实验研究一致。在特征空间中的详细分析使我们能够识别这种缺陷转换和排列的最佳途径。与其他全局优化方案,如遗传算法的比较表明,MCTS与延迟奖励需要更少的评价,并达到更好的质量的解决方案。各种采样的缺陷配置上的2 H到1 T相变在二硫化钼的影响进行了讨论。总的来说,我们引入了一种采用延迟奖励的强化学习(RL)策略,可以加速材料缺陷的逆向设计,以实现目标功能。

英文摘要:

Defect dynamics in materials are of central importance to a broad range of technologies from catalysis to energy storage systems to microelectronics. Material functionality depends strongly on the nature and organization of defects, their arrangements often involve intermediate or transient states that present a high barrier for transformation. The lack of knowledge of these intermediate states and the presence of this energy barrier presents a serious challenge for inverse defect design, especially for gradient-based approaches. Here, we present a reinforcement learning (Monte Carlo Tree Search) based on delayed rewards that allow for efficient search of the defect configurational space and allows us to identify optimal defect arrangements in low dimensional materials. Using a representative case of 2D MoS2, we demonstrate that the use of delayed rewards allows us to efficiently sample the defect configurational space and overcome the energy barrier for a wide range of defect concentrations (from 1.5% to 8% S vacancies), the system evolves from an initial randomly distributed S vacancies to one with extended S line defects consistent with previous experimental studies. Detailed analysis in the feature space allows us to identify the optimal pathways for this defect transformation and arrangement. Comparison with other global optimization schemes like genetic algorithms suggests that the MCTS with delayed rewards takes fewer evaluations and arrives at a better quality of the solution. The implications of the various sampled defect configurations on the 2H to 1T phase transitions in MoS2 are discussed. Overall, we introduce a Reinforcement Learning (RL) strategy employing delayed rewards that can accelerate the inverse design of defects in materials for achieving targeted functionality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑