NOM：用于高分组存储器中跨组数据传输的存储器网络
NOM: Network-On-Memory for Inter-Bank Data Transfer in Highly-Banked Memories
摘要：
数据复制是许多程序和操作系统服务中广泛使用的存储器操作。在传统的计算机中，数据复制通常由两个单独的读写事务来执行，这两个事务在DRAM芯片和处理器芯片之间来回传递数据。一些现有机制提出通过使用DRAM芯片中的共享内部总线来直接复制DRAM芯片内的数据来避免这种不必要的数据移动（例如，两个DRAM存储体之间）。虽然这些方法与传统技术相比表现出优越的性能，但是跨不同DRAM库的数据复制仍然比在同一DRAM库内的数据复制慢得多。因此，这些技术对于新兴的3D堆叠存储器（例如，HMC和HBM），其包含跨多个存储器控制器的数百个DRAM组。在本文中，我们提出了内存网络（NoM），一个轻量级的银行间数据通信计划，使直接数据复制跨两个存储体的三维堆叠存储器。NoM采用基于TDM的电路交换设计，其中电路设置由存储器控制器完成。与最先进的方法相比，NoM实现了多个DRAM存储体之间的快速数据复制和并发数据传输操作。我们的评估表明，与基线传统3D堆叠DRAM架构和最先进的技术相比，NoM将数据密集型工作负载的性能平均提高了3.8倍和75%。
英文摘要：
Data copy is a widely-used memory operation in many programs and operating system services. In conventional computers, data copy is often carried out by two separate read and write transactions that pass data back and forth between the DRAM chip and the processor chip. Some prior mechanisms propose to avoid this unnecessary data movement by using the shared internal bus in the DRAM chip to directly copy data within the DRAM chip (e.g., between two DRAM banks). While these methods exhibit superior performance compared to conventional techniques, data copy across different DRAM banks is still greatly slower than data copy within the same DRAM bank. Hence, these techniques have limited benefit for the emerging 3D-stacked memories (e.g., HMC and HBM) that contain hundreds of DRAM banks across multiple memory controllers. In this paper, we present Network-on-Memory (NoM), a lightweight inter-bank data communication scheme that enables direct data copy across both memory banks of a 3D-stacked memory. NoM adopts a TDM-based circuit-switching design, where circuit setup is done by the memory controller. Compared to state-of-the-art approaches, NoM enables both fast data copy between multiple DRAM banks and concurrent data transfer operations. Our evaluation shows that NoM improves the performance of data-intensive workloads by 3.8X and 75%, on average, compared to the baseline conventional 3D-stacked DRAM architecture and state-of-the-art techniques, respectively.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
