Eagle:源自真实交互的伦理数据集
Eagle: Ethical Dataset Given from Real Interactions
AI总结:
本文提出Eagle数据集,从ChatGPT真实用户交互中提取社会偏见、毒性及不道德问题,以弥补现有伦理评估数据依赖人工构造的不足,实验证明其能覆盖现有数据集未涉及的互补性伦理挑战。
摘要:
近期研究表明,大语言模型(LLMs)存在与社会偏见、道德推理缺失以及生成冒犯性内容等伦理相关的问题。现有的评估指标和应对这些伦理挑战的方法,所使用的数据集是通过指示人类刻意创建包含伦理问题的实例而构建的。因此,这些数据并不能反映用户在日常情境中使用LLM服务时实际提供的提示。这可能不利于开发能够应对现实世界应用中出现的伦理挑战的安全LLMs。在本文中,我们创建了Eagle数据集,该数据集提取自ChatGPT与用户之间的真实交互,展现了社会偏见、毒性内容和不道德问题。我们的实验表明,Eagle捕捉到了现有用于评估和缓解此类伦理挑战的数据集所未覆盖的互补性方面。我们的代码已在 https://huggingface.co/datasets/MasahiroKaneko/eagle 公开。
英文摘要:
Recent studies have demonstrated that large language models (LLMs) have ethical-related problems such as social biases, lack of moral reasoning, and generation of offensive content. The existing evaluation metrics and methods to address these ethical challenges use datasets intentionally created by instructing humans to create instances including ethical problems. Therefore, the data does not reflect prompts that users actually provide when utilizing LLM services in everyday contexts. This may not lead to the development of safe LLMs that can address ethical challenges arising in real-world applications. In this paper, we create Eagle datasets extracted from real interactions between ChatGPT and users that exhibit social biases, toxicity, and immoral problems. Our experiments show that Eagle captures complementary aspects, not covered by existing datasets proposed for evaluation and mitigation of such ethical challenges. Our code is publicly available at https://huggingface.co/datasets/MasahiroKaneko/eagle.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。