arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.13709cs.CLcs.AI
收藏

SaGE:评估大语言模型中的道德一致性

SaGE: Evaluating Moral Consistency in Large Language Models

International Institute of Information Technology Hyderabad (IIITH)(国际信息技术学院海得拉巴分校(IIITH));University of Maryland Baltimore County (UMBC)(马里兰大学巴尔的摩县分校(UMBC))

Vamshi Krishna Bonagiri, Sreeram Vennam, Priyanshul Govil, Ponnurangam Kumaraguru, Manas Gaur

AI总结:

针对大语言模型存在的道德不一致问题,本研究提出基于经验法则的语义图熵(SaGE)度量方法,构建道德一致性语料库,并验证其在多数据集上的泛化性,发现任务准确率与一致性是独立问题。

摘要:

尽管近期的研究进展展现了大语言模型(LLMs)在对话系统中令人瞩目的能力,但我们发现,即便是最先进的LLMs,其生成内容也存在道德不一致的问题,这对它们的可靠性(以及整体可信度)提出了质疑。此前的LLM评估研究主要侧重于构建基准真值数据,以衡量模型在特定任务上的准确率。但对于往往缺乏公认答案的道德场景而言,模型回答的一致性对其可靠性至关重要。为解决这一问题,我们提出了一种名为语义图熵(Semantic Graph Entropy, SaGE)的信息论度量方法,该方法以“经验法则”(Rules of Thumb, RoTs)概念为基础,用于衡量模型的道德一致性。RoTs是模型习得的抽象原则,可有效解释其决策策略。为此,我们构建了道德一致性语料库(Moral Consistency Corpus, MCC),包含5万个道德问题、LLM对这些问题的回答,以及这些模型遵循的RoTs。此外,为说明SaGE的泛化性,我们用它研究了LLM在两个流行数据集——TruthfulQA和HellaSwag上的一致性。我们的结果表明,任务准确率和一致性是相互独立的问题,亟需对这些问题开展进一步研究。

英文摘要:

Despite recent advancements showcasing the impressive capabilities of Large Language Models (LLMs) in conversational systems, we show that even state-of-the-art LLMs are morally inconsistent in their generations, questioning their reliability (and trustworthiness in general). Prior works in LLM evaluation focus on developing ground-truth data to measure accuracy on specific tasks. However, for moral scenarios that often lack universally agreed-upon answers, consistency in model responses becomes crucial for their reliability. To address this issue, we propose an information-theoretic measure called Semantic Graph Entropy (SaGE), grounded in the concept of "Rules of Thumb" (RoTs) to measure a model's moral consistency. RoTs are abstract principles learned by a model and can help explain their decision-making strategies effectively. To this extent, we construct the Moral Consistency Corpus (MCC), containing 50K moral questions, responses to them by LLMs, and the RoTs that these models followed. Furthermore, to illustrate the generalizability of SaGE, we use it to investigate LLM consistency on two popular datasets -- TruthfulQA and HellaSwag. Our results reveal that task-accuracy and consistency are independent problems, and there is a dire need to investigate these issues further.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑