到达即失效:GPU微架构中死项TLB缺失的特征描述与防护
Dead on Arrival: Characterizing and Protecting Against Dead-Entry TLB Misses in GPU Microarchitectures
AI总结:
本文通过分析GPU工作负载中L2 TLB死项缺失问题,将其分为突发放大和容量溢出两类,并设计DEPOT机制(1KB Bloom过滤器)防止近期被驱逐的翻译立即被替换,最高提升72%的IPC,且与其他优化技术兼容。
摘要:
具有大内存足迹的GPU工作负载经常遭受冗余的L2 TLB缺失,其中最近被驱逐的翻译立即以全页遍历成本重新遍历。我们在24个GPU工作负载中表征了这些死项缺失,发现它们在TLB最敏感的应用中占L2 TLB缺失的99%,但其性能影响因内存访问结构而异。线程束共享同一虚拟页的工作负载遭受突发放大,其中一次驱逐使许多线程束同时等待一个翻译返回。相比之下,每个线程束访问不同页集的工作负载面临任何替换策略都无法解决的容量溢出问题,这一区别通过大页实验得到验证。基于这种两类分类法,我们设计了DEPOT(死项保护),一种1KB Bloom过滤器机制,防止最近被驱逐的翻译在重新安装后立即被替换,在干扰驱动的工作负载上提供高达72%的IPC改进,而对其他工作负载零开销,并与最先进的TLB预取和压缩机制组合,额外获得2%至7%的增益。
英文摘要:
GPU workloads with large memory footprints frequently suffer from redundant L2 TLB misses in which a recently evicted translation is immediately re-walked at full page-walk cost. We characterize these dead-entry misses across 24 GPU workloads, finding they account for up to 99% of L2 TLB misses in the most TLB-sensitive applications, yet their performance impact varies widely depending on memory access structure. Workloads where warps share the same virtual page suffer from burst amplification, where a single eviction stalls many warps simultaneously waiting for one translation to return. In contrast, workloads where each warp accesses a distinct set of pages face a capacity-overflow problem that no replacement policy can resolve, a distinction validated by huge page experiments. Building on this two-class taxonomy, we design DEPOT (Dead-Entry PrOTection), a 1 KB Bloom filter mechanism that prevents recently evicted translations from being displaced immediately upon reinstallation, delivering up to 72% IPC improvement on interference-driven workloads with zero overhead on others, and composing with the state-of-the-art TLB prefetching and compaction mechanism, for 2 to 7% additional gain.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。