arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1804.00478cs.DC
收藏

一种利用语义局部性的神经网络存储器预取器

A neural network memory prefetcher using semantic locality

Leeor Peled, Uri Weiser, Yoav Etsion

摘要:

准确的存储器预取对于处理器性能是至关重要的,并且现代处理器采用各种技术来识别和预取不同的存储器访问模式。虽然大多数现代预取器的目标时空模式匹配的内存地址,在接近访问(无论是在空间或时间),最近提出的概念,语义局部性视图局部性作为一个工件的算法水平和搜索内存访问和程序状态之间的相关性。虽然这种方法被证明是有效的,捕捉语义局部性需要显着的联想学习能力。在本文中,我们利用神经网络为这项任务。我们利用机器学习的最新进展,提出了一个神经网络预取。我们表明,通过观察程序上下文,这个预取可以学习不同的内存访问模式,不能覆盖其他国家的最先进的预取。我们评估的神经网络预取超过SPEC2006,Graph500,和几个微基准。我们表明,预取器可以提供一个平均加速30%的SPEC2006(高达2.7倍)和高达4.6倍的内核。我们还提出了一个高层次的设计,我们的预取器,探讨功率,能源和面积的限制,并提出了几个可行性的优化。我们相信,这一系列的研究可以进一步提高这种神经网络的效率,并允许利用它们进行额外的微架构预测。

英文摘要:

Accurate memory prefetching is paramount for processor performance, and modern processors employ various techniques to identify and prefetch different memory access patterns. While most modern prefetchers target spatio-temporal patterns by matching memory addresses that are accessed in close proximity (either in space or time), the recently proposed concept of semantic locality views locality as an artifact of the algorithmic level and searches for correlations between memory accesses and program state. While this approach was shown to be effective, capturing semantic locality requires significant associative learning capabilities. In this paper we utilize neural networks for this task. We leverage recent advances in machine learning to propose a neural network prefetcher. We show that by observing program context, this prefetcher can learn distinct memory access patterns that cannot be covered by other state-of-the-art prefetchers. We evaluate the neural network prefetcher over SPEC2006, Graph500, and several microbenchmarks. We show that the prefetcher can deliver an average speedup of 30% for SPEC2006 (up to 2.7x) and up to 4.6x over kernels. We also present a high-level design of our prefetcher, explore the power, energy and area limitations, and propose several optimizations for feasibility. We believe that this line of research can further improve the efficiency of such neural networks and allow harnessing them for additional micro-architectural predictions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑