arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.00611cs.SEcs.AI
收藏

利用大型语言模型和检索增强生成增强AI研究中的代码一致性

Enhancing Code Consistency in AI Research with Large Language Models and Retrieval-Augmented Generation

NVIDIA(英伟达)

Rajat Keshri, Arun George Zachariah, Michael Boone

AI总结:

本文提出一种利用检索增强生成和大型语言模型自动验证代码实现与研究论文算法一致性的系统,提升了验证准确性与全面性,促进了AI研究的透明度、可复现性及研究可信度。

摘要:

确保代码准确反映研究论文中描述的算法和方法,对于维护AI研究的可信度和促进信任至关重要。本文提出了一种新系统,旨在根据相关研究论文中概述的算法和方法验证代码实现。该系统采用检索增强生成(RAG)从研究论文和代码库中提取相关细节,随后使用大型语言模型(LLM)进行结构化比较。该方法提高了代码实现验证的准确性和全面性,同时促进了AI研究的透明度、可解释性和可复现性。通过自动化验证过程,该系统减少了人工工作量,增强了研究可信度,并最终推动了代码验证领域的最新技术发展。

英文摘要:

Ensuring that code accurately reflects the algorithms and methods described in research papers is critical for maintaining credibility and fostering trust in AI research. This paper presents a novel system designed to verify code implementations against the algorithms and methodologies outlined in corresponding research papers. Our system employs Retrieval-Augmented Generation to extract relevant details from both the research papers and code bases, followed by a structured comparison using Large Language Models. This approach improves the accuracy and comprehensiveness of code implementation verification while contributing to the transparency, explainability, and reproducibility of AI research. By automating the verification process, our system reduces manual effort, enhances research credibility, and ultimately advances the state of the art in code verification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑