DataRaceBench V1.4.1 与 DataRaceBench-ML V0.1:面向数据竞争检测的基准套件
DataRaceBench V1.4.1 and DataRaceBench-ML V0.1: Benchmark Suites for Data Race Detection
AI总结:
本文更新 DataRaceBench 并推出派生数据集 DRB-ML,通过细粒度竞争标签、变量信息及提示-响应对,支持机器学习与大语言模型的数据竞争检测研究。
摘要:
数据竞争会对程序正确性产生负面影响,因此在多线程并行应用中构成重大威胁。DataRaceBench 是一个开源基准套件,专门用于以系统化、可度量的方式评估这些数据竞争检测工具。近年来,机器学习技术在高性能计算(HPC)程序分析与优化中展现出相当大的潜力。然而,这些技术需要专门的数据格式来进行训练和改进。本文介绍 DataRaceBench 的最新更新,纳入了 Wu 等人(Wu et al.,\cite{wu2023model})贡献的新数据竞争,并引入了一个名为 DataRaceBench-ML(DRB-ML)的派生数据集(\cite{drbml})。DRB-ML 顺应了机器学习和大语言模型的新兴趋势。该数据集源自 DataRaceBench,包含用于表示是否存在数据竞争的详细标签,并提供相关变量的全面细节,例如变量名、行号以及操作(读/写)。作为 DRB-ML 的独特之处,作者还集成了一系列专门为 LLM 微调设计的定制提示-响应对。
英文摘要:
Data races pose a significant threat in multi-threaded parallel applications due to their negative impact on program correctness. DataRaceBench, an open-source benchmark suite, is specifically crafted to assess these data race detection tools in a systematic and measurable manner. Machine learning techniques have recently demonstrated considerable potential in high-performance computing (HPC) program analysis and optimization. However, these techniques require specialized data formats for training and refinement. This paper presents the latest update to DataRaceBench, incorporating new data race contributions from Wu et al. \cite{wu2023model}, and introduces a derived dataset named DataRaceBench-ML (DRB-ML) \cite{drbml}. DRB-ML aligns with the emerging trend of machine learning and large language models. Originating from DataRaceBench, this dataset includes detailed labels that denote the presence of a data race and provides comprehensive details of associated variables, such as variable names, line numbers, and the operation (read/write). Unique to DRB-ML, we have also integrated a series of tailored prompt-response pairs specifically designed for LLM fine-tuning.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。