arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.09568cs.AR
收藏

晶圆级计算:进展、挑战与未来展望

Wafer-scale Computing: Advancements, Challenges, and Future Perspectives

Yang Hu, Xinhan Lin, Huizheng Wang, Zhen He, Xingmao Yu, Jiahao Zhang, Qize Yang, Zheng Xu, Sihan Guan, Jiahao Fang, Haoran Shang, Xinru Tang, Xu Dai, Shaojun Wei, Shouyi Yin

AI总结:

针对AI算力需求增长与硬件算力不足的矛盾,本文首次系统综述晶圆级计算的技术进展、设计挑战与未来方向,涵盖架构、协同优化、功耗冷却及工具链,为学术界和工业界提供一站式参考。

摘要:

如今,具有大模型的人工智能(AI)技术在学术界和工业界都发挥着越来越重要的作用,同时也带来了对硬件计算能力快速增长的需求。随着AI计算需求的持续增长,硬件计算能力的增长已无法跟上,这已成为制约AI发展的一个重要因素。硬件计算能力的提升主要依赖于晶体管密度和芯片面积的增加。然而,前者受到摩尔定律和Dennard缩放终止的阻碍,后者则受到打破传统制造设备和工艺挑战的显著限制。近年来,逐渐成熟的先进封装技术越来越多地被用于实现集成多个小芯片(chiplet)的更大芯片,同时仍提供具有芯片级密度和带宽的互连。与多加速器和数据中心级计算等传统高性能计算范式相比,晶圆级计算在通信带宽、集成密度和可编程性潜力方面显示出显著优势。毫不意外,颠覆性的晶圆级计算也为硬件架构、设计-系统-技术协同优化、功耗与冷却系统以及编译器工具链带来了前所未有的设计挑战。目前,尚无全面综述总结晶圆级计算的当前状态和设计见解。本文旨在迈出第一步,帮助学术界和工业界一站式地回顾现有的晶圆级芯片和关键技术,使人们能够方便地掌握基础知识和要点,理解现有研究的成就与不足,并为这一有前景的研究方向做出贡献。

英文摘要:

Nowadays, artificial intelligence (AI) technology with large models plays an increasingly important role in both academia and industry. It also brings a rapidly increasing demand for the computing power of the hardware. As the computing demand for AI continues to grow, the growth of hardware computing power has failed to keep up. This has become a significant factor restricting the development of AI. The augmentation of hardware computing power is mainly propelled by the escalation of transistor density and chip area. However, the former is impeded by the termination of the Moore's Law and Dennard scaling, and the latter is significantly restricted by the challenge of disrupting the legacy fabrication equipment and process. In recent years, advanced packaging technologies that have gradually matured are increasingly used to implement bigger chips that integrate multiple chiplets, while still providing interconnections with chip-level density and bandwidth. Compared to conventional high-performance computing paradigms such as multi-accelerator and datacenter-scale computing, Wafer-scale Computing shows remarkable advantages in communication bandwidth, integration density, and programmability potential. Not surprisingly, disruptive Wafer-scale Computing also brings unprecedented design challenges for hardware architecture, design-system-technology co-optimization, power and cooling systems, and compiler tool chain. At present, there are no comprehensive surveys summarizing the current state and design insights of Wafer-scale Computing. This paper aims to take the first step to help academia and industry review existing wafer-scale chips and essential technologies in a one-stop manner. So that people can conveniently grasp the basic knowledge and key points, understand the achievements and shortcomings of existing research, and contribute to this promising research direction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑