arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.04428cs.CLcs.AI
收藏

MoralBench:大语言模型的道德评估

MoralBench: Moral Evaluation of LLMs

Rutgers The State University of New Jersey(新泽西州立大学拉特格斯分校);University of Chicago(芝加哥大学)

Jianchao Ji, Yutong Chen, Mingyu Jin, Wujiang Xu, Wenyue Hua, Yongfeng Zhang

AI总结:

本文提出MoralBench基准及数据集,用于系统评估和比较大语言模型的道德推理能力,并通过多模型实验揭示其道德表现差异与局限性。

摘要:

在快速发展的人工智能领域,大语言模型(LLMs)已成为从自然语言处理到决策支持系统等众多应用中的强大工具。然而,随着这些模型日益融入社会框架,确保它们在伦理和道德边界内运行变得前所未有的重要。本文引入了一个新的基准,旨在衡量和比较LLMs的道德推理能力。我们提出了首个专门为探查LLM输出的道德维度而精心构建的综合数据集,涵盖反映现实世界复杂性的广泛伦理困境和场景。\n 这项工作的主要贡献在于开发了用于评估LLMs道德身份的基准数据集和指标,这些数据集和指标考虑了细微差别、情境敏感性以及与人类伦理标准的一致性。我们的方法采用多方面策略,将定量分析与伦理学学者的定性见解相结合,以确保对模型性能进行全面评估。通过将我们的基准应用于多个领先的LLMs,我们揭示了不同模型在道德推理能力上的显著差异。这些发现强调了在LLMs的开发和评估中考虑道德推理的重要性,以及需要持续研究以解决我们研究中发现的偏见和局限性。我们在 https://drive.google.com/drive/u/0/folders/1k93YZJserYc2CkqP8d4B3M3sgd3kA8W7 公开发布该基准,并在 https://github.com/agiresearch/MoralBench 开源项目代码。

英文摘要:

In the rapidly evolving field of artificial intelligence, large language models (LLMs) have emerged as powerful tools for a myriad of applications, from natural language processing to decision-making support systems. However, as these models become increasingly integrated into societal frameworks, the imperative to ensure they operate within ethical and moral boundaries has never been more critical. This paper introduces a novel benchmark designed to measure and compare the moral reasoning capabilities of LLMs. We present the first comprehensive dataset specifically curated to probe the moral dimensions of LLM outputs, addressing a wide range of ethical dilemmas and scenarios reflective of real-world complexities. The main contribution of this work lies in the development of benchmark datasets and metrics for assessing the moral identity of LLMs, which accounts for nuance, contextual sensitivity, and alignment with human ethical standards. Our methodology involves a multi-faceted approach, combining quantitative analysis with qualitative insights from ethics scholars to ensure a thorough evaluation of model performance. By applying our benchmark across several leading LLMs, we uncover significant variations in moral reasoning capabilities of different models. These findings highlight the importance of considering moral reasoning in the development and evaluation of LLMs, as well as the need for ongoing research to address the biases and limitations uncovered in our study. We publicly release the benchmark at https://drive.google.com/drive/u/0/folders/1k93YZJserYc2CkqP8d4B3M3sgd3kA8W7 and also open-source the code of the project at https://github.com/agiresearch/MoralBench.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑