切片无序核中的高速公路到存储器级并行性
Freeway to Memory Level Parallelism in Slice-Out-of-Order Cores
摘要:
利用内存级并行(MLP)是隐藏长内存和末级缓存访问延迟的关键。虽然乱序(OoO)内核和基于它们的技术在利用MLP方面是有效的,但由于其复杂且耗能的硬件,它们的能效很低。这项工作重新访问切片无序(sOOO)核心作为MLP开发的节能替代方案。SOOO核通过构造和执行MLP的\textit{slices}来实现能量效率,所述MLP生成指令仅相对于其余指令乱序;片和其余指令本身按序执行。然而,我们观察到,现有的sOoO核心错过了显着的MLP机会,由于其依赖无关的顺序切片执行,这导致依赖切片频繁块MLP生成。为了提高MLP的生成,我们引入了Freeway,这是一个基于新的依赖感知切片执行策略的sOoO核心,该策略跟踪依赖切片,并防止它们阻塞后续的独立切片和MLP提取。建议的核心招致最小的面积和功率开销,但方法的MLP的好处完全面向对象的核心。我们的评估表明,Freeway的性能比最先进的sOoO核心高出12%,并且在完全OoO执行的MLP限制的7%以内。
英文摘要:
Exploiting memory level parallelism (MLP) is crucial to hide long memory and last level cache access latencies. While out-of-order (OoO) cores, and techniques building on them, are effective at exploiting MLP, they deliver poor energy efficiency due to their complex and energy-hungry hardware. This work revisits slice-out-of-order (sOoO) cores as an energy efficient alternative for MLP exploitation. sOoO cores achieve energy efficiency by constructing and executing \textit{slices} of MLP generating instructions out-of-order only with respect to the rest of instructions; the slices and the remaining instructions, by themselves, execute in-order. However, we observe that existing sOoO cores miss significant MLP opportunities due to their dependence-oblivious in-order slice execution, which causes dependent slices to frequently block MLP generation. To boost MLP generation, we introduce Freeway, a sOoO core based on a new dependence-aware slice execution policy that tracks dependent slices and keeps them from blocking subsequent independent slices and MLP extraction. The proposed core incurs minimal area and power overheads, yet approaches the MLP benefits of fully OoO cores. Our evaluation shows that Freeway delivers 12% better performance than the state-of-the-art sOoO core and is within 7% of the MLP limits of full OoO execution.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。