模拟深度学习的前景：最新进展、挑战与机遇
The Promise of Analog Deep Learning: Recent Advances, Challenges and Opportunities
AI总结：
针对现有AI硬件综述对模拟深度学习进展讨论不足的问题，本文从精度、能效等多维度系统评估八种模拟深度学习方法的优劣与进展，指出其消费级应用潜力大但可扩展性仍待突破。
摘要：
当今的人工智能（AI）大多采用人工神经网络，这是一类旨在通过从数据中学习来识别模式、解决复杂问题的精密计算模型。然而，在设备计算前向传播的加权和以及反向传播的优化过程时会出现重大瓶颈，对于深度神经网络（即具有大量层级的网络）而言尤为突出。探索神经网络的不同实现方式对该领域的进一步发展十分必要。尽管目前针对AI硬件已有大量模拟与数字实现两个方向的研究，但现有综述工作大多缺乏对模拟深度学习进展的讨论。为此，本文尝试评估并明确模拟实现方式的优缺点，以及其在深度学习领域的当前进展。本文重点围绕多个关键参数，对八种不同的模拟深度学习方法展开全面考察，这些参数包括达到的精度水平、应用领域、算法进展、计算速度，以及能效与功耗方面的考量。本文还梳理了采用这些硬件设备实现的基于神经网络的实验，讨论了不同模拟深度学习方法取得的性能对比，并分析了其当前存在的局限性。总体而言，研究发现模拟深度学习在未来消费级应用中具备巨大潜力，但在可扩展性方面仍有很长的路要走；当前大多数实现更多属于概念验证阶段，尚未能实际部署于大规模模型。
英文摘要：
Much of the present-day Artificial Intelligence (AI) utilizes artificial neural networks, which are sophisticated computational models designed to recognize patterns and solve complex problems by learning from data. However, a major bottleneck occurs during a device's calculation of weighted sums for forward propagation and optimization procedure for backpropagation, especially for deep neural networks, or networks with numerous layers. Exploration into different methods of implementing neural networks is necessary for further advancement of the area. While a great deal of research into AI hardware in both directions, analog and digital implementation widely exists, much of the existing survey works lacks discussion on the progress of analog deep learning. To this end, we attempt to evaluate and specify the advantages and disadvantages, along with the current progress with regards to deep learning, for analog implementations. In this paper, our focus lies on the comprehensive examination of eight distinct analog deep learning methodologies across multiple key parameters. These parameters include attained accuracy levels, application domains, algorithmic advancements, computational speed, and considerations of energy efficiency and power consumption. We also identify the neural network-based experiments implemented using these hardware devices and discuss comparative performance achieved by the different analog deep learning methods along with an analysis of their current limitations. Overall, we find that Analog Deep Learning has great potential for future consumer-level applications, but there is still a long road ahead in terms of scalability. Most of the current implementations are more proof of concept and are not yet practically deployable for large-scale models.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
