Recent advancements in large language models (LLMs) have sparked significant interest in the automatic generation of Register Transfer Level (RTL) designs, particularly using Verilog. Current research on this topic primarily focuses on pre-training and instruction tuning, but the effectiveness of these methods is constrained by the limited availability of training data, as public Verilog code is far less abundant than software code. In particular, these methods struggle to effectively capture Verilog parallel code structures, which fundamentally differ from the imperative, sequential control flow typical in most software programming languages. This paper introduces VeriSeek, an LLM enhanced by reinforcement learning using a limited amount of high-quality training data to achieve high Verilog code generation performance. Our reinforcement learning approach employs code structure information as feedback signals to refine the pre-trained model, enabling it to effectively learn important patterns from Verilog code with parallel structures. Experiments show that VeriSeek outperforms state-of-the-art methods across multiple benchmarks.
EvolVE: Evolutionary Search for LLM-based Verilog Generation and Optimization
Department of Electrical Engineering(电气工程系);National Taiwan University(国立台湾大学);Department of Computer Science and Information Engineering(计算机科学与信息工程系);Institute of Information Science(信息科学研究所)
TGPO: Tree-Guided Preference Optimization for Robust Web Agent Reinforcement Learning
East China Normal University(东华大学);Alibaba Group(阿里巴巴集团);University of Electronic Science and Technology of China(电子科技大学);Wuhan University(武汉大学);Sun Yat-sen University(中山大学)
本文提出树引导偏好优化(TGPO)框架,通过树结构轨迹表示、过程奖励模型和动态加权机制,解决 Web Agent 强化学习中的信用分配错位、标注成本高和奖励稀疏问题,并在两个数据集上取得更高成功率和更少冗余步骤。
ChipSeek: Optimizing Verilog Generation via EDA-Integrated Reinforcement Learning
SKLP, Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所智能计算机研究中心);University of Chinese Academy of Sciences(中国科学院大学);University of Electronic Science and Technology of China(电子科技大学);Beijing Institute of Technology(北京理工大学)
Quality over Quantity: Diversity-Aware Data Selection for Efficient Verilog Code Generation
Northwestern Polytechnical University(西北工业大学);Nantong Normal College(南通师范高等专科学校);East China Normal University(华东师范大学);Nantong University(南通大学);Zhejiang University(浙江大学)
QiMeng-SALV: Signal-Aware Learning for Verilog Code Generation
State Key Lab of Processors, Institute of Computing Technology, CAS(处理器国家重点实验室,计算技术研究所,中国科学院);University of Chinese Academy of Sciences(中国科学院大学);University of Science and Technology of China(中国科学技术大学)
RTLSeek: Boosting the LLM-Based RTL Generation with Multi-Stage Diversity-Oriented Reinforcement Learning
State Key Lab of Processors, Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所处理器国家重点实验室);University of Chinese Academy of Sciences(中国科学院大学);Peking University(北京大学);CASTEST Co., Ltd.(中科芯测科技有限公司)