arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2311.09585cs.CL

LifeTox:揭示生活建议中的隐性毒性

LifeTox: Unveiling Implicit Toxicity in Life Advice

Seoul National University(首尔大学);Chung-Ang University(中央大学);NAVER AI Lab(NAVER AI实验室);NAVER Cloud(NAVER云);University of Richmond(里士满大学)

Minbeom Kim, Jahyun Koo, Hwanhee Lee, Joonsuk Park, Hwaran Lee, Kyomin Jung

AI总结:

针对生活建议场景中的隐性毒性检测,构建LifeTox数据集,微调RoBERTa达到或超越大模型零样本性能,并开源数据集及三种规模模型。

摘要:

随着大型语言模型日益融入日常生活,检测不同语境下的隐性毒性至关重要。为此,我们引入了LifeTox,一个旨在识别广泛寻求建议场景中隐性毒性的数据集。与现有的安全数据集不同,LifeTox通过开放式问题从个人经历中衍生出多样化的语境。实验表明,在LifeTox上微调的RoBERTa在毒性分类任务中达到或超越了大型语言模型的零样本性能。这些结果凸显了LifeTox在应对隐性毒性固有复杂挑战方面的有效性。我们开源了该数据集(https://huggingface.co/datasets/mbkim/LifeTox)以及LifeTox审核员系列模型;350M、7B和13B。

英文摘要:

As large language models become increasingly integrated into daily life, detecting implicit toxicity across diverse contexts is crucial. To this end, we introduce LifeTox, a dataset designed for identifying implicit toxicity within a broad range of advice-seeking scenarios. Unlike existing safety datasets, LifeTox comprises diverse contexts derived from personal experiences through open-ended questions. Experiments demonstrate that RoBERTa fine-tuned on LifeTox matches or surpasses the zero-shot performance of large language models in toxicity classification tasks. These results underscore the efficacy of LifeTox in addressing the complex challenges inherent in implicit toxicity. We open-sourced the dataset\footnote{\url{https://huggingface.co/datasets/mbkim/LifeTox}} and the LifeTox moderator family; 350M, 7B, and 13B.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑