SHIFT:面向通信感知的基于芯粒系统的动态计算重定位框架
SHIFT: Dynamic Compute Relocation Framework for Communication-Aware Chiplet-Based Systems
AI总结:
提出SHIFT框架,通过动态迁移计算节点上下文和数据到更优位置,结合改进的最短路径算法和轻量级ML辅助策略,在芯粒架构上实现通信感知的负载放置与路由优化,显著提升延迟、吞吐量和能效。
摘要:
大规模异构系统日益增长的通信复杂性推动了运行时方法在通信感知的工作负载放置和路由优化方面的发展。本文通过提出SHIFT(一种新颖的拓扑无关方法)来解决这些通信限制,该方法将计算节点上下文和数据迁移到更合适位置的节点,而不是像传统片上网络中那样仅移动数据。所提出的策略在基于芯粒的架构上进行评估,该架构利用细间距集成平台,具有多个带宽域以支持异构工作负载。所提出的架构在功能或存储芯粒与实用芯粒之间采用多层路由,实用芯粒作为路由和计算重定位的智能节点。自适应调度和路由采用针对大规模系统改进的最短路径算法,并辅以轻量级ML辅助策略,该策略推断流量条件以提高自适应性。为建立性能基线,初始评估使用随机指令向量和数据模式来评估SHIFT的基本能力。仿真结果显示,在不同配置下,成功重定位占总试验次数的75.2%至97.9%,平均延迟改善16.4%-62.5%,最大改善76.8%。此外,吞吐量提升高达12.5倍,单位面积功耗降低约8%,每比特能耗降低高达58.3%,性能提升18%。为评估高逻辑和数据密度下的效率,该框架在标准LLM工作负载上进行了测试。结果显示,运行时间、吞吐量和能效分别平均提升4.9倍、5.9倍和1.8倍,超越了最先进的晶圆级LLM服务,并展示了与大规模平台和应用的兼容性。
英文摘要:
The increasing communication complexity of large-scale heterogeneous systems has motivated runtime methodologies for communication-aware workload placement and routing optimization. These communication limitations are addressed in this paper by proposing SHIFT, a novel topology-agnostic approach that transfers compute node context and data to a more suitably positioned node, rather than only shifting data as in conventional networks-on-chip. The proposed strategy is evaluated on a chiplet-based architecture utilizing a fine-pitch integration platform featuring multiple bandwidth-domains for heterogeneous workloads. The proposed architecture employs multi-layered routing between functional or memory chiplets and utility chiplets, which serve as intelligent nodes for routing and compute relocation. Adaptive scheduling and routing utilize a modified shortest-path algorithm for large-scale systems, complemented by a lightweight ML-assisted policy that infers traffic conditions to improve adaptivity. To establish a performance baseline, the initial assessment uses random instruction vectors and data patterns to evaluate the fundamental capabilities of SHIFT. Simulation results exhibit successful relocations over total trials ranging from 75.2% to 97.9% across configurations, with average latency improvements of 16.4%-62.5% and a maximum of 76.8%. In addition, throughput is improved by up to 12.5x, power dissipation per unit area is reduced by ~8%, energy-per-bit is reduced by up to 58.3%, and performance is improved by 18%. To evaluate efficiency under high logic and data density, the framework was tested on standard LLM workloads. Results exhibit average improvements of 4.9x, 5.9x, and 1.8x in runtime, throughput, and energy-efficiency, respectively, surpassing state-of-the-art wafer-scale LLM services and demonstrating compatibility with large-scale platforms and applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。