arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2605.23715cs.CL

NLG评估:过去、现在与未来

NLG Evaluation: Past, Present, Future

Dept of Computing Science University of Aberdeen(计算科学系大学阿伯丁)

Ehud Reiter

AI总结:

本文回顾了自然语言生成(NLG)评估从1990年至今的演变,包括LLM-as-Judge等最新方法,并展望了未来影响、质量和安全评估的重要性。

摘要:

自然语言生成(NLG)评估自1990年以来发生了巨大变化,并将继续演变。1990年,当NLG与语言学紧密相连时,几乎没有现代意义上的正式实验评估。到2026年,当NLG与机器学习紧密相关时,实验评估已成为研究的基础和预期。在此期间,开发了许多评估技术,包括最近的LLM-as-Judge。我预计NLG评估将在未来继续演变。特别是,随着大量人群日常使用NLG技术,影响、质量和安全评估将变得更加重要。

英文摘要:

Natural Language Generation (NLG) evaluation has changed dramatically since 1990, and will continue to evolve in the future. In 1990, when NLG had close ties to linguistics, there was very little formal experimental evaluation in the modern sense. In 2026, when NLG is closely linked to machine learning, experimental evaluation is expected and indeed fundamental to research. Many evaluation techniques were developed over this period, including most recently LLM-as-Judge. I expect NLG evaluation will continue to evolve in the future. In particular, impact, qualitative, and safety evaluation will become more important as large numbers of people routinely use NLG technology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑