理解神经网络引导的TEM图像分析中感受野和网络复杂性的影响
Understanding the Influence of Receptive Field and Network Complexity in Neural-Network-Guided TEM Image Analysis
摘要:
经过训练的神经网络是分析不断增加的科学图像数据量的有前途的工具,但目前还不清楚如何最好地定制这些网络,以适应透射电子显微照片的独特功能。在这里,我们系统地研究了神经网络结构的选择如何影响神经网络如何在透射电子显微镜(TEM)图像中将结晶纳米颗粒与无定形背景分割或逐像素分离。我们专注于解耦的影响,感受野,或输入图像的面积,有助于输出决策,从网络的复杂性,这决定了可训练参数的数量。我们发现,对于依赖于振幅对比度来区分纳米颗粒与背景的低分辨率TEM图像,感受野并不显著影响分割性能。另一方面,对于依赖于振幅和相位对比度变化的组合来识别纳米颗粒的高分辨率TEM图像,感受野是提高性能的关键参数,特别是在具有最小振幅对比度的图像中。我们的研究结果为如何使神经网络适应TEM数据集的应用提供了见解和指导。
英文摘要:
Trained neural networks are promising tools to analyze the ever-increasing amount of scientific image data, but it is unclear how to best customize these networks for the unique features in transmission electron micrographs. Here, we systematically examine how neural network architecture choices affect how neural networks segment, or pixel-wise separate, crystalline nanoparticles from amorphous background in transmission electron microscopy (TEM) images. We focus on decoupling the influence of receptive field, or the area of the input image that contributes to the output decision, from network complexity, which dictates the number of trainable parameters. We find that for low-resolution TEM images which rely on amplitude contrast to distinguish nanoparticles from background, the receptive field does not significantly influence segmentation performance. On the other hand, for high-resolution TEM images which rely on a combination of amplitude and phase contrast changes to identify nanoparticles, receptive field is a key parameter for increased performance, especially in images with minimal amplitude contrast. Our results provide insight and guidance as to how to adapt neural networks for applications with TEM datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。