HBF-Sim:面向大规模GPU内存系统的可扩展HBF模拟器
HBF-Sim: An Extensible HBF Simulator for Large-scale GPU Memory Systems
浏览论文内容
中文总结 AI 辅助
针对现有模拟器无法建模HBF行为的问题,提出与GPU集成的可扩展HBF模拟器HBF-Sim,通过MSHR映射和页级多堆栈管理建模完整请求路径,并揭示性能瓶颈以指导架构设计。
中文摘要 AI 辅助
高带宽闪存(HBF)被引入以解决内存墙问题,它可以将高密度NAND堆栈与GPU共同封装,瞄准近加速器带宽与闪存密度之间的性能差距。然而,HBF既不是大型HBM,也不是快速的NVMe SSD。其可用带宽取决于GPU缓存行请求如何映射到NAND页、并发性如何在通道仿射的die集合间分布,以及介质管理如何与GPU内存流水线交互。据我们所知,现有的GPU、SSD或HBF模拟器无法忠实地建模这种行为。我们提出了HBF-Sim,一个与模拟GPU集成的可扩展、可重用且忠实的HBF模拟器。它在一条端到端的请求路径中闭合了GPU发出限制、设备排队和NAND行为之间的回路。HBF-Sim将GPU-HBF交互控制器与基于页的并行堆栈存储分离,并建模完整的GPU-HBF请求路径。它提供了一个基于MSHR的地址映射表,将缓存行请求合并为基于页的操作,以及一个基于页的多堆栈闪存管理器,用于高度并行的读写。验证测试和设备级微基准测试揭示了由有限通道分布和资源冲突引起的性能瓶颈,为下一代HBF架构提供了具体指导。
英文摘要
High-bandwidth flash (HBF) is introduced to address the memory wall, which can co-package a dense NAND stack with the GPU, targeting the performance gap between near-accelerator bandwidth and flash density. HBF, however, is neither a large HBM nor a fast NVMe SSD. Its usable bandwidth depends on how GPU cache-line requests map onto NAND pages, how concurrency spreads across channel-affine die sets, and how media management interacts with the GPU memory pipeline. To our knowledge, existing GPU, SSD, or HBF simulators cannot faithfully model this behavior. We present HBF-Sim, an extensible, reusable, and faithful HBF simulator integrated with simulated GPUs. It closes the loop between GPU issue limits, device queuing, and NAND behavior in one end-to-end request path. HBF-Sim separates a GPU-HBF interaction controller from page-based parallel stack storage, and it models the full GPU-HBF request path. It provides an MSHR-based address mapping table that merges cache-line requests into page-based operations, as well as a page-based multi-stack flash manager for highly parallel reads and writes. Validation tests and device-level microbenchmarks expose performance bottlenecks caused by limited channel distribution and resource conflicts, offering concrete guidance for next-generation HBF architectures.
发表机构
- East China Normal University(华东师范大学)
- Shanghai Innovation Institute(上海创新研究院)
机构由 AI 辅助整理,请以论文原文为准。