arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.13671cs.ARcs.LGcs.NIcs.OS
收藏

一种改进近记忆处理系统中数据与计算映射的持续学习方法

Continual Learning Approach for Improving the Data and Computation Mapping in Near-Memory Processing System

Texas A&M University(德克萨斯A&M大学);UC Santa Barbara(加州大学圣塔芭芭拉分校)

Pritam Majumder, Jiayi Huang, Sungkeun Kim, Abdullah Muzahid, Dylan Siegers, Chia-Che Tsai, Eun Jung Kim

摘要:

随着大数据的出现,近内存处理(NMP)的复兴已经将计算范式从以处理器为中心的计算转变为以内存为中心的计算。为了满足以存储器为中心的计算的带宽和容量需求,已经采用3D存储器来形成可扩展的存储立方体网络。随着NMP和存储系统的发展,存储立方体网络中的数据放置和引导计算的映射已经成为推动NMP性能改进的关键。然而,由于应用行为的独特性和决策空间的复杂性,设计一个通用的最优映射是非常具有挑战性的。在本文中,我们提出了一个人工智能的内存映射方案,AIMM,优化数据的位置和资源利用率,通过页面和计算重新映射。我们提出的技术涉及不断评估和学习映射决策对任何应用程序的系统性能的影响。AIMM使用神经网络在执行过程中实现接近最优的映射,使用强化学习算法进行训练,该算法已知可有效探索广阔的设计空间。我们还提供了一个详细的AIMM硬件设计,可以采用作为一个插件模块的各种NMP系统。我们的实验评估表明,AIMM提高了基线NMP的性能,在单一和多个程序的情况下,分别高达70%和50%。

英文摘要:

The resurgence of near-memory processing (NMP) with the advent of big data has shifted the computation paradigm from processor-centric to memory-centric computing. To meet the bandwidth and capacity demands of memory-centric computing, 3D memory has been adopted to form a scalable memory-cube network. Along with NMP and memory system development, the mapping for placing data and guiding computation in the memory-cube network has become crucial in driving the performance improvement in NMP. However, it is very challenging to design a universal optimal mapping for all applications due to unique application behavior and intractable decision space. In this paper, we propose an artificially intelligent memory mapping scheme, AIMM, that optimizes data placement and resource utilization through page and computation remapping. Our proposed technique involves continuously evaluating and learning the impact of mapping decisions on system performance for any application. AIMM uses a neural network to achieve a near-optimal mapping during execution, trained using a reinforcement learning algorithm that is known to be effective for exploring a vast design space. We also provide a detailed AIMM hardware design that can be adopted as a plugin module for various NMP systems. Our experimental evaluation shows that AIMM improves the baseline NMP performance in single and multiple program scenario by up to 70% and 50%, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑