arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.01069cs.CL
收藏

LLMCRIT:教大型语言模型使用评价标准

LLMCRIT: Teaching Large Language Models to Use Criteria

New York University(纽约大学);Shanghai Jiao Tong University(上海交通大学);Cohere

Weizhe Yuan, Pengfei Liu, Matthias Gallé

AI总结:

针对现有研究仅考虑有限评价标准的问题,提出LLMCRIT模型在环框架,通过半自动提取全面标准并构建上下文演示,使大型语言模型能为写作任务提供自然语言反馈,实验验证了其细粒度效果。

摘要:

人类在执行任务时会遵循评价标准,这些标准被直接用于评估任务完成的质量。因此,让模型学会使用标准来提供反馈,有助于人类或模型更好地执行任务。然而,该领域现有研究往往只考虑有限的标准或质量评估方面。为填补这一空白,我们提出了一个通用框架,使大型语言模型(LLMs)能够针对任务执行,使用全面的标准来提供自然语言反馈。具体而言,我们提出了一个模型在环(model-in-the-loop)框架,该框架半自动地从收集到的不同写作任务的指南中提取标准,并为每个标准构建上下文演示。我们选择真实世界场景中的三个任务来实施这一想法:论文引言写作、Python代码写作和Reddit帖子写作,并使用不同的LLMs评估了我们的反馈生成框架。结果揭示了引入标准和演示的细粒度效果,并就如何更有效地教LLMs使用标准提供了有价值的见解。

英文摘要:

Humans follow criteria when they execute tasks, and these criteria are directly used to assess the quality of task completion. Therefore, having models learn to use criteria to provide feedback can help humans or models to perform tasks better. However, existing research in this field tends to consider only a limited set of criteria or quality assessment aspects. To fill this gap, we propose a general framework that enables large language models (LLMs) to use comprehensive criteria for a task in delivering natural language feedback on task execution. In particular, we present a model-in-the-loop framework that semi-automatically derives criteria from collected guidelines for different writing tasks and constructs in-context demonstrations for each criterion. We choose three tasks from real-world scenarios to operationalize this idea: paper introduction writing, Python code writing, and Reddit post writing, and evaluate our feedback generation framework using different LLMs. The results reveal the fine-grained effects of incorporating criteria and demonstrations and provide valuable insights on how to teach LLMs to use criteria more effectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑