arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1907.02167cs.AR
收藏

更新还是不更新?:DRAM高速缓存的带宽有效智能替换策略

To Update or Not To Update?: Bandwidth-Efficient Intelligent Replacement Policies for DRAM Caches

Vinson Young, Moinuddin K. Qureshi

摘要:

本文研究了智能替换策略,以提高命中率的千兆级DRAM缓存。高速缓存替换策略通常用于提高片上高速缓存的命中率。最有效的替换策略通常需要缓存跟踪每行的重用状态,以告知它们的决策。然而,DRAM高速缓存的一个根本挑战是,有状态策略将需要大量带宽来维持每行DRAM高速缓存状态。因此,DRAM高速缓存替换策略主要是无状态策略,例如始终安装或概率旁路。不幸的是,我们发现,无状态的政策往往过于粗粒度,并成为无效的DRAM缓存的大小和关联性。理想情况下,我们想要一个可以获得有状态替换策略的命中率优势,但保持无状态策略的带宽效率的替换策略。在我们的研究中,我们发现,跟踪每行重用状态可以实现有效的替换策略,可以减轻常见的颠簸模式中看到千兆级缓存。我们提出了一个有状态的替换/旁路策略,称为RRIP旁路(RRIP-AOB),跟踪重用状态的高重用线,保护这些线绕过其他线路,和年龄的状态高速缓存旁路。不幸的是,这种有状态技术需要大量带宽来更新状态。为此,我们提出了有效的重用跟踪(ETR)。ETR通过准确跟踪区域中仅一条线的状态,并使用该线的状态来指导该区域中其他线的替换决策,从而使状态跟踪高效。ETR将跟踪替换状态的带宽减少了70%,并使DRAM缓存的有状态策略变得实用。我们的评估与2GB的DRAM缓存,表明我们的RRIP-AOB和ETR技术提供了18%的加速比,而需要不到1 KB的SRAM。

英文摘要:

This paper investigates intelligent replacement policies for improving the hit-rate of gigascale DRAM caches. Cache replacement policies are commonly used to improve the hit-rate of on-chip caches. The most effective replacement policies often require the cache to track per-line reuse state to inform their decision. A fundamental challenge on DRAM caches, however, is that stateful policies would require significant bandwidth to maintain per-line DRAM cache state. As such, DRAM cache replacement policies have primarily been stateless policies, such as always-install or probabilistic bypass. Unfortunately, we find that stateless policies are often too coarse-grain and become ineffective at the size and associativity of DRAM caches. Ideally, we want a replacement policy that can obtain the hit-rate benefits of stateful replacement policies, but keep the bandwidth-efficiency of stateless policies. In our study, we find that tracking per-line reuse state can enable an effective replacement policy that can mitigate common thrashing patterns seen in gigascale caches. We propose a stateful replacement/bypass policy called RRIP Age-On-Bypass (RRIP-AOB), that tracks reuse state for high-reuse lines, protects such lines by bypassing other lines, and Ages the state On cache Bypass. Unfortunately, such a stateful technique requires significant bandwidth to update state. To this end, we propose Efficient Tracking of Reuse (ETR). ETR makes state tracking efficient by accurately tracking the state of only one line from a region, and using the state of that line to guide the replacement decisions for other lines in that region. ETR reduces the bandwidth for tracking replacement state by 70%, and makes stateful policies practical for DRAM caches. Our evaluations with a 2GB DRAM cache, show that our RRIP-AOB and ETR techniques provide 18% speedup while needing less than 1KB of SRAM.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑