arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.10653cs.AIcs.LG
收藏

逻辑综合优化中的因果Transformer预测性自监督方法

Logic Synthesis Optimization with Predictive Self-Supervision via Causal Transformers

Huawei Noah’s Ark Lab(华为诺亚方舟实验室)

Raika Karimi, Faezeh Faez, Yingxue Zhang, Xing Li, Lei Chen, Mingxuan Yuan, Mahdi Biparva

AI总结:

针对逻辑综合优化中数据稀缺和泛化问题,提出LSOformer,利用因果Transformer和预测性自监督学习预测QoR轨迹,在多个数据集上显著提升预测精度。

摘要:

当代硬件设计受益于高级逻辑门提供的抽象,从而简化了逻辑电路的实现。逻辑综合优化(LSO)在电子设计自动化(EDA)工作流程中的某一抽象层级上运行,旨在针对最终布局中的性能指标(如面积和速度)改进逻辑电路。该领域的最新趋势显示出对利用机器学习(ML)进行EDA的兴趣日益增长,特别是通过基于策略的强化学习(RL)方法进行ML引导的逻辑综合。尽管取得了这些进展,现有模型仍面临过拟合和泛化能力有限等挑战,这归因于公共电路的受限性以及图编码器表达能力的限制。为了解决这些障碍并应对数据稀缺问题,我们引入了LSOformer,这是一种利用自回归Transformer模型和预测性自监督学习(SSL)来预测结果质量(QoR)轨迹的新方法。LSOformer集成了交叉注意力模块,以融合来自电路图和优化序列的见解,从而提高QoR指标的预测准确性。实验研究验证了LSOformer的有效性,展示了其在QoR预测任务中优于基线架构的性能,在归纳设置下,分别在EPFL、OABCD和专有电路数据集上实现了5.74%、4.35%和17.06%的提升。

英文摘要:

Contemporary hardware design benefits from the abstraction provided by high-level logic gates, streamlining the implementation of logic circuits. Logic Synthesis Optimization (LSO) operates at one level of abstraction within the Electronic Design Automation (EDA) workflow, targeting improvements in logic circuits with respect to performance metrics such as size and speed in the final layout. Recent trends in the field show a growing interest in leveraging Machine Learning (ML) for EDA, notably through ML-guided logic synthesis utilizing policy-based Reinforcement Learning (RL) methods.Despite these advancements, existing models face challenges such as overfitting and limited generalization, attributed to constrained public circuits and the expressiveness limitations of graph encoders. To address these hurdles, and tackle data scarcity issues, we introduce LSOformer, a novel approach harnessing Autoregressive transformer models and predictive SSL to predict the trajectory of Quality of Results (QoR). LSOformer integrates cross-attention modules to merge insights from circuit graphs and optimization sequences, thereby enhancing prediction accuracy for QoR metrics. Experimental studies validate the effectiveness of LSOformer, showcasing its superior performance over baseline architectures in QoR prediction tasks, where it achieves improvements of 5.74%, 4.35%, and 17.06% on the EPFL, OABCD, and proprietary circuits datasets, respectively, in inductive setup.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑