面向鲁棒模拟计算的钙钛矿忆阻器与算法协同开发
Synergistic Development of Perovskite Memristors and Algorithms for Robust Analog Computing
AI总结:
针对钙钛矿忆阻器非理想特性阻碍模拟计算应用的问题,提出器件制备与算法协同优化方法,通过贝叶斯优化筛选最优器件参数、BO引导噪声注入训练鲁棒DNN,实现多任务性能最高百倍提升。
摘要:
基于非易失性忆阻器的模拟计算已成为高能效深度学习的一种极具前景的解决方案。钙钛矿基忆阻器等新型材料凭借其成本效益、能效和灵活性,近年来备受关注。然而,材料多样性和制备工艺不成熟的问题,使得器件开发需要开展大量实验。此外,这类忆阻器存在显著的非理想特性,往往会阻碍其在计算中的应用。\n本文提出一种协同方法,可同时优化钙钛矿忆阻器的制备工艺,并开发鲁棒的模拟深度神经网络(DNN),有效解决这类忆阻器的固有非理想特性问题。我们采用侧重可用性的贝叶斯优化(Bayesian optimization, BO),高效确定钙钛矿忆阻器的最优材料与制备条件。同时,我们开发了“BayesMulti”这一DNN训练策略,利用BO引导的噪声注入提升模拟DNN对忆阻器缺陷的抵抗能力。该方法从理论上保证,在忆阻器非理想特性导致的参数扰动处于一定范围内时,预测结果保持一致。\n我们的集成方法可将模拟计算应用于更深、更宽的网络,在图像分类、自动驾驶、物种识别和大视觉语言模型等多种任务中显著优于现有方法,性能提升最高可达100倍。我们进一步在10×10的优化钙钛矿忆阻器交叉阵列上验证了该方法,证明其在分类任务中具备高精度且能耗低。本研究为各类模拟计算系统的高效优化提供了一种通用方案,覆盖器件和算法两个层面。
英文摘要:
Analog computing using non-volatile memristors has emerged as a promising solution for energy-efficient deep learning. New materials, like perovskites-based memristors are recently attractive due to their cost-effectiveness, energy efficiency and flexibility. Yet, challenges in material diversity and immature fabrications require extensive experimentation for device development. Moreover, significant non-idealities in these memristors often impede them for computing. Here, we propose a synergistic methodology to concurrently optimize perovskite memristor fabrication and develop robust analog DNNs that effectively address the inherent non-idealities of these memristors. Employing Bayesian optimization (BO) with a focus on usability, we efficiently identify optimal materials and fabrication conditions for perovskite memristors. Meanwhile, we developed "BayesMulti", a DNN training strategy utilizing BO-guided noise injection to improve the resistance of analog DNNs to memristor imperfections. Our approach theoretically ensures that within a certain range of parameter perturbations due to memristor non-idealities, the prediction outcomes remain consistent. Our integrated approach enables use of analog computing in much deeper and wider networks, which significantly outperforms existing methods in diverse tasks like image classification, autonomous driving, species identification, and large vision-language models, achieving up to 100-fold improvements. We further validate our methodology on a 10$\times$10 optimized perovskite memristor crossbar, demonstrating high accuracy in a classification task and low energy consumption. This study offers a versatile solution for efficient optimization of various analog computing systems, encompassing both devices and algorithms.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。