arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.16343cs.AR
收藏

Trimma:削减混合内存系统的元数据存储与延迟

Trimma: Trimming Metadata Storage and Latency for Hybrid Memory Systems

Yiwei Li, Boyu Tian, Mingyu Gao

AI总结:

针对混合内存系统中数据块重映射的元数据存储与查找开销,提出结合多级元数据结构与高效元数据缓存的Trimma设计,在HBM3和DDR5系统上实现平均1.33倍加速。

摘要:

混合主存系统结合了来自异构内存技术的性能和容量优势。随着容量更大、相联度更高和粒度更细,混合内存系统目前在两个内存层之间灵活重映射数据块时表现出显著的元数据存储和查找开销。为了缓解现有设计的低效问题,我们提出了Trimma,它结合了多级元数据结构和高效的元数据缓存设计。Trimma使用多级元数据表仅跟踪真正必要的地址重映射条目。节省的内存空间被有效用作额外的DRAM缓存容量以提升性能。Trimma还使用单独的格式存储具有非一致和一致地址映射的条目。这提高了整体重映射缓存命中率,进一步提升了性能。Trimma对软件透明,并与各种类型的混合内存系统兼容。在具有HBM3和DDR5的代表性混合内存系统上进行评估时,与最先进的混合内存设计相比,Trimma实现了高达1.68倍、平均1.33倍的加速收益。这些结果表明,Trimma有效解决了元数据管理开销,特别是对于未来可扩展的大规模混合内存架构。

英文摘要:

Hybrid main memory systems combine both performance and capacity advantages from heterogeneous memory technologies. With larger capacities, higher associativities, and finer granularities, hybrid memory systems currently exhibit significant metadata storage and lookup overheads for flexibly remapping data blocks between the two memory tiers. To alleviate the inefficiencies of existing designs, we propose Trimma, the combination of a multi-level metadata structure and an efficient metadata cache design. Trimma uses a multi-level metadata table to only track truly necessary address remap entries. The saved memory space is effectively utilized as extra DRAM cache capacity to improve performance. Trimma also uses separate formats to store the entries with non-identity and identity address mappings. This improves the overall remap cache hit rate, further boosting the performance. Trimma is transparent to software and compatible with various types of hybrid memory systems. When evaluated on a representative hybrid memory system with HBM3 and DDR5, Trimma achieves up to 1.68$\times$ and on average 1.33$\times$ speedup benefits, compared to state-of-the-art hybrid memory designs. These results show that Trimma effectively addresses metadata management overheads, especially for future scalable large-scale hybrid memory architectures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑