深度神经网络的持久主导地位:对量子机器学习和脉冲神经网络根本局限性的批判性分析
The Enduring Dominance of Deep Neural Networks: A Critical Analysis of the Fundamental Limitations of Quantum Machine Learning and Spiking Neural Networks
AI总结:
本文批判性分析量子机器学习和脉冲神经网络的根本局限,论证其在短期内难以取代深度神经网络,并指出DNN凭借高效反向传播、稳健正则化及推理时扩展创新,仍是AI发展的主导范式。
摘要:
量子机器学习(QML)和脉冲神经网络(SNN)的最新进展引发了相当大的热潮,有望通过指数级加速和类脑能效来彻底改变人工智能。然而,本文认为,它们在短期内不太可能取代深度神经网络(DNN)。QML在适应反向传播方面面临困难,原因在于酉约束、测量引起的态坍缩、贫瘠高原以及高测量开销,而当前含噪中等规模量子硬件的局限性、由于正则化技术不成熟导致的过拟合风险,以及其与机器学习泛化目标的根本性错位,进一步加剧了这些挑战。SNN则面临受限的表征带宽,由于其基于离散脉冲的处理方式,在处理长程依赖和语言任务中的语义编码时存在困难。此外,忠实模拟大脑的目标可能会引入固有的低效性,如认知偏差、有限的工作记忆和缓慢的学习速度。即便是其备受吹捧的能效优势也被夸大了;在现实条件下,经过量化的优化DNN在能耗方面可以胜过SNN。最后,SNN的训练因时间展开而带来高昂的计算开销。相比之下,DNN利用了高效的反向传播、稳健的正则化,以及大型推理模型(LRM)中的创新,这些创新将扩展转移到推理时计算,通过强化学习(RL)和诸如蒙特卡洛树搜索(MCTS)等搜索算法实现自我改进,同时缓解了数据稀缺问题。这一优越性在最近的模型中得到了证明,例如xAI的Grok-4 Heavy,它推进了最先进的性能,以及gpt-oss-120b,尽管其规模仅为1200亿参数,可在单个80GB GPU上部署,却超越或接近了领先行业模型的性能。此外,专用集成电路(ASIC)进一步放大了这些效率优势。最终,QML和SNN可能服务于小众的混合角色,但DNN仍然是人工智能发展的主导且实用的范式。
英文摘要:
Recent advancements in QML and SNNs have generated considerable excitement, promising exponential speedups and brain-like energy efficiency to revolutionize AI. However, this paper argues that they are unlikely to displace DNNs in the near term. QML struggles with adapting backpropagation due to unitary constraints, measurement-induced state collapse, barren plateaus, and high measurement overheads, exacerbated by the limitations of current noisy intermediate-scale quantum hardware, overfitting risks due to underdeveloped regularization techniques, and a fundamental misalignment with machine learning's generalization. SNNs face restricted representational bandwidth, struggling with long-range dependencies and semantic encoding in language tasks due to their discrete, spike-based processing. Furthermore, the goal of faithfully emulating the brain might impose inherent inefficiencies like cognitive biases, limited working memory, and slow learning speeds. Even their touted energy-efficient advantages are overstated; optimized DNNs with quantization can outperform SNNs in energy costs under realistic conditions. Finally, SNN training incurs high computational overhead from temporal unfolding. In contrast, DNNs leverage efficient backpropagation, robust regularization, and innovations in LRMs that shift scaling to inference-time compute, enabling self-improvement via RL and search algorithms like MCTS while mitigating data scarcity. This superiority is evidenced by recent models such as xAI's Grok-4 Heavy, which advances SOTA performance, and gpt-oss-120b, which surpasses or approaches the performance of leading industry models despite its modest 120-billion-parameter size deployable on a single 80GB GPU. Furthermore, specialized ASICs amplify these efficiency gains. Ultimately, QML and SNNs may serve niche hybrid roles, but DNNs remain the dominant, practical paradigm for AI advancement.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。