arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.08680cs.CLcs.DLcs.IR
收藏

通过领域专用大语言模型微调实现研究综述自动化

Automating Research Synthesis with Domain-Specific Large Language Model Fine-Tuning

Cyberoo Pty Ltd(Cyberoo私人有限公司)

Teo Susnjak, Peter Hwang, Napoleon H. Reyes, Andre L. C. Barczak, Timothy R. McIntosh, Surangika Ranathunga

AI总结:

本文提出用开源LLM领域微调自动化SLR的知识综合阶段,并通过复现PRISMA综述验证准确性、抑制幻觉和来源追踪。

摘要:

本研究开创性地使用经过微调的大语言模型(LLM)来自动化系统性文献综述(SLR),在整合人工智能以优化学术研究方法方面作出了重要且新颖的贡献。我们的研究采用最新的微调方法以及开源LLM,展示了一种实用且高效的方法,用于自动化SLR流程中涉及知识综合的最终执行阶段。结果在LLM回答的事实准确性方面保持了高保真度,并通过复现一项符合PRISMA规范的现有SLR得到验证。本研究提出了缓解LLM幻觉的解决方案,并提出了将LLM回答追踪至其信息来源的机制,从而展示该方法如何能够满足学术研究的严格要求。研究结果最终证实,经过微调的LLM有潜力简化开展文献综述时各种劳动密集型流程。鉴于该方法的潜力及其在所有研究领域的适用性,这项基础性研究还倡导更新PRISMA报告指南,以纳入AI驱动的流程,确保未来SLR中的方法透明度和可靠性。本研究拓展了AI增强工具在各学术和研究领域的吸引力,为在学术研究数量不断增长的背景下更高效地开展全面、准确的文献综述设立了新标准。

英文摘要:

This research pioneers the use of fine-tuned Large Language Models (LLMs) to automate Systematic Literature Reviews (SLRs), presenting a significant and novel contribution in integrating AI to enhance academic research methodologies. Our study employed the latest fine-tuning methodologies together with open-sourced LLMs, and demonstrated a practical and efficient approach to automating the final execution stages of an SLR process that involves knowledge synthesis. The results maintained high fidelity in factual accuracy in LLM responses, and were validated through the replication of an existing PRISMA-conforming SLR. Our research proposed solutions for mitigating LLM hallucination and proposed mechanisms for tracking LLM responses to their sources of information, thus demonstrating how this approach can meet the rigorous demands of scholarly research. The findings ultimately confirmed the potential of fine-tuned LLMs in streamlining various labor-intensive processes of conducting literature reviews. Given the potential of this approach and its applicability across all research domains, this foundational study also advocated for updating PRISMA reporting guidelines to incorporate AI-driven processes, ensuring methodological transparency and reliability in future SLRs. This study broadens the appeal of AI-enhanced tools across various academic and research fields, setting a new standard for conducting comprehensive and accurate literature reviews with more efficiency in the face of ever-increasing volumes of academic studies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑