CARE-MI:面向母婴护理领域错误信息评估的中文基准
CARE-MI: Chinese Benchmark for Misinformation Evaluation in Maternity and Infant Care
AI总结:
本文提出中文母婴护理领域错误信息评估基准CARE-MI,包含1612个专家检查问题,并通过实验揭示当前中文大语言模型在该领域表现不足,同时提供自动判断模型以降低人工评估成本。
摘要:
自然语言处理(NLP)的最新进展推动了将大语言模型(LLMs)应用于现实场景的新趋势。尽管最新的LLMs在与人类交互时表现出惊人的流畅性,但它们仍面临错误信息问题,即无意中生成事实错误的陈述。这可能带来有害后果,尤其是在医疗保健等敏感语境中产生时。然而,以往很少有工作专注于评估LLMs在长文本(LF)生成中的错误信息,尤其是针对知识密集型主题。此外,尽管LLMs已被证明在不同语言中表现良好,但错误信息评估大多以英语进行。为此,我们提出了一个基准CARE-MI,用于评估LLM在以下方面的错误信息:1)一个敏感主题,即母婴护理领域;2)一种非英语语言,即中文。最重要的是,我们提供了一种创新的范式,用于构建长文本生成评估基准,该范式可迁移到其他知识密集型领域和低资源语言。我们提出的基准填补了LLMs的广泛使用与缺乏用于评估这些模型生成的错误信息的数据集之间的空白。它包含1,612个经专家检查的问题,并附有人工选择的参考答案。使用我们的基准,我们进行了大量实验,发现当前的中文LLMs在母婴护理主题上远非完美。为了尽量减少性能评估对人力资源的依赖,我们提供了现成的判断模型,用于在给定基准问题时自动评估LLM的长文本输出。此外,我们比较了长文本生成评估的潜在解决方案,并为构建更好的自动化评估指标提供了见解。
英文摘要:
The recent advances in natural language processing (NLP), have led to a new trend of applying large language models (LLMs) to real-world scenarios. While the latest LLMs are astonishingly fluent when interacting with humans, they suffer from the misinformation problem by unintentionally generating factually false statements. This can lead to harmful consequences, especially when produced within sensitive contexts, such as healthcare. Yet few previous works have focused on evaluating misinformation in the long-form (LF) generation of LLMs, especially for knowledge-intensive topics. Moreover, although LLMs have been shown to perform well in different languages, misinformation evaluation has been mostly conducted in English. To this end, we present a benchmark, CARE-MI, for evaluating LLM misinformation in: 1) a sensitive topic, specifically the maternity and infant care domain; and 2) a language other than English, namely Chinese. Most importantly, we provide an innovative paradigm for building LF generation evaluation benchmarks that can be transferred to other knowledge-intensive domains and low-resourced languages. Our proposed benchmark fills the gap between the extensive usage of LLMs and the lack of datasets for assessing the misinformation generated by these models. It contains 1,612 expert-checked questions, accompanied with human-selected references. Using our benchmark, we conduct extensive experiments and found that current Chinese LLMs are far from perfect in the topic of maternity and infant care. In an effort to minimize the reliance on human resources for performance evaluation, we offer off-the-shelf judgment models for automatically assessing the LF output of LLMs given benchmark questions. Moreover, we compare potential solutions for LF generation evaluation and provide insights for building better automated metrics.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。