arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.06707cs.CL
收藏

评估大型语言模型的会计推理能力

Evaluating Accounting Reasoning Capabilities of Large Language Models

School of Computer Engineering, Jiangsu Ocean University(计算机工程学院,江苏海洋大学)

Jie Zhou, Xin Chen, Jie Zhang, Hai Li, Jie Wang, Zhe Li

AI总结:

本文评估了大型语言模型在会计推理任务中的能力,通过定义垂直领域会计推理标准,分析了GLM和GPT-4等模型的表现,发现提示设计对性能影响显著,但现有模型仍需优化以满足实际需求。

摘要:

大型语言模型正在许多领域改变学习、认知和研究。有效地将它们整合到专业领域,如会计,是企业数字化转型的关键挑战。为此,我们定义了垂直领域会计推理,并提出了基于代表性GLM模型训练数据特征分析得出的评估标准。这些标准支持对会计推理的系统研究,并为性能提升提供了基准。使用此框架,我们对GLM-6B、GLM-130B、GLM-4和OpenAI GPT-4进行了会计推理任务的评估。结果显示,提示设计显著影响性能,GPT-4表现出最强的能力。尽管有这些进步,当前模型仍不足以满足现实中的企业会计需求,表明需要进一步优化以释放其全部实际价值。

英文摘要:

Large language models are transforming learning, cognition, and research across many fields. Effectively integrating them into professional domains, such as accounting, is a key challenge for enterprise digital transformation. To address this, we define vertical domain accounting reasoning and propose evaluation criteria derived from an analysis of the training data characteristics of representative GLM models. These criteria support systematic study of accounting reasoning and provide benchmarks for performance improvement. Using this framework, we evaluate GLM-6B, GLM-130B, GLM-4, and OpenAI GPT-4 on accounting reasoning tasks. Results show that prompt design significantly affects performance, with GPT-4 demonstrating the strongest capability. Despite these gains, current models remain insufficient for real-world enterprise accounting, indicating the need for further optimization to unlock their full practical value.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑