Atom-by-atom assembly of functional materials and devices is perceived as one of the ultimate targets of nanoscience and nanotechnology. While traditionally implemented via scanning probe microscopy techniques, recently it has been shown that the beam of a scanning transmission electron microscope can be used for targeted manipulation of individual atoms. However, the process is highly dynamic in nature and proceeds via a large number of weakly-understood individual steps. Hence, harnessing an electron beam towards atomic assembly requires automated methods to control the parameters and positioning of the beam in such a way as to fabricate atomic-scale structures reliably. Here, we create a molecular dynamics environment wherein individual atom velocities can be modified, effectively simulating a beam-induced interaction, and apply reinforcement learning to model construction of specific atomic units consisting of Si dopant atoms on a graphene lattice. We find that it is possible to engineer the reward function of the agent in such a way as to encourage formation of local clusters of dopants, whilst at the same time minimizing the amplitude of momentum changes. Inspection of the learned policies indicates that of fundamental importance is the component of velocity perpendicular to the material plane, and further, that the high stochasticity of the environment leads to conservative policies. This study shows the potential for reinforcement learning agents trained in simulated environments for potential use as atomic scale fabricators, and further, that the dynamics learned by agents encode specific elements of important physics that can be learned.
Polymer-free van der Waals assembly of 2D material heterostructures using muscovite crystals
Institute for Functional Intelligent Materials, National University of Singapore(新加坡国立大学功能智能材料研究所);Department of Materials Science and Engineering, National University of Singapore(新加坡国立大学材料科学与工程系)
Hebei Normal University(河北师范大学);Beijing Information Science and Technology University(北京信息科技大学);Songshan Lake Materials Laboratory(松山湖材料实验室);Zhejiang University of Technology(浙江工业大学)
Programmable self-assembly for scalable molecular electronic architectures
The Kavli Institute for Nanoscience Discovery, University of Oxford(牛津大学卡弗里纳米科学发现研究所);Department of Chemistry, University of Oxford(牛津大学化学系);The Clarendon Laboratory, Department of Physics, University of Oxford(牛津大学物理系克拉伦登实验室);School of Physical and Chemical Sciences, Queen Mary University of London(伦敦大学玛丽女王学院物理与化学科学学院);Department of Chemistry, Durham University(杜伦大学化学系)