基于机器学习的拥塞预测器对有效且不可察觉扰动的鲁棒性与泛化性
On Robustness and Generalization of ML-Based Congestion Predictors to Valid and Imperceptible Perturbations
AI总结:
本文研究基于 ML 的 EDA 拥塞预测器对不可察觉扰动的脆弱性,提出保证不改变全局布线的扰动定义,并通过对抗性单元移动揭示 CNN/GNN 模型失效,同时给出提升鲁棒性的训练方法。
摘要:
在整个电子计算机辅助设计(CAD)流程中,人们对使用基于机器学习(ML)的技术有着浓厚兴趣,尤其是基于深度学习的方法。然而,尽管深度学习方法已在若干应用中取得最先进性能,近期研究表明,神经网络通常容易受到对其输入进行的微小而精心选择的扰动影响(例如图像中的单个像素变化)。在本工作中,我们研究基于机器学习的 EDA 工具背景下的鲁棒性,特别是拥塞预测。据我们所知,我们是首个在基于机器学习的 EDA 背景下探索这一概念的工作。\n我们首先描述了一种专为定义在网表和单元布局上的 VLSI 布局问题设计的新颖不可察觉性概念。我们对不可察觉性的定义以一项保证为特征:对布局的扰动不会改变其全局布线。随后,我们证明最先进的基于 CNN 和 GNN 的拥塞模型对不可察觉扰动表现出脆弱性。具体而言,我们表明,当少量单元(例如 1%–5% 的单元)的位置发生移动,并且保证全局拥塞度量保持不受影响时(例如,对设计中 1% 的部分进行对抗性移动,移动幅度为布局空间的 0.001%,会导致预测拥塞降低至多 90%,而该扰动并不意味着拥塞发生任何变化)。换言之,对于任意输入布局,预测器的质量都可以被任意变差(即可以使其预测某个设计“无拥塞”)。接下来,我们描述了一种简单的预测器训练技术,可提高对这些扰动的鲁棒性。我们的工作表明,CAD 工程师在将基于神经网络的机制集成到 EDA 流程中时应保持谨慎,以确保结果鲁棒且高质量。
英文摘要:
There is substantial interest in the use of machine learning (ML)-based techniques throughout the electronic computer-aided design (CAD) flow, particularly methods based on deep learning. However, while deep learning methods have achieved state-of-the-art performance in several applications, recent work has demonstrated that neural networks are generally vulnerable to small, carefully chosen perturbations of their input (e.g. a single pixel change in an image). In this work, we investigate robustness in the context of ML-based EDA tools -- particularly for congestion prediction. As far as we are aware, we are the first to explore this concept in the context of ML-based EDA. We first describe a novel notion of imperceptibility designed specifically for VLSI layout problems defined on netlists and cell placements. Our definition of imperceptibility is characterized by a guarantee that a perturbation to a layout will not alter its global routing. We then demonstrate that state-of-the-art CNN and GNN-based congestion models exhibit brittleness to imperceptible perturbations. Namely, we show that when a small number of cells (e.g. 1%-5% of cells) have their positions shifted such that a measure of global congestion is guaranteed to remain unaffected (e.g. 1% of the design adversarially shifted by 0.001% of the layout space results in a predicted decrease in congestion of up to 90%, while no change in congestion is implied by the perturbation). In other words, the quality of a predictor can be made arbitrarily poor (i.e. can be made to predict that a design is "congestion-free") for an arbitrary input layout. Next, we describe a simple technique to train predictors that improves robustness to these perturbations. Our work indicates that CAD engineers should be cautious when integrating neural network-based mechanisms in EDA flows to ensure robust and high-quality results.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。