ToVo:基于投票的毒性分类法
ToVo: Toxicity Taxonomy via Voting
AI总结:
针对现有毒性检测模型缺乏透明度、可定制性和可复现性的问题,本文提出一种整合投票与思维链的数据集创建机制,生成高质量开源数据集,并训练出更透明、可微调且性能优于现有检测器的模型。
摘要:
现有的毒性检测模型面临显著局限性,如缺乏透明度、可定制性和可复现性。这些挑战源于其训练数据的闭源性以及对其评估机制解释的匮乏。为解决这些问题,我们提出了一种整合投票与思维链过程的数据集创建机制,生成一个高质量的开源毒性内容检测数据集。我们的方法确保每个样本具有多样化的分类指标,并同时包含分类得分和分类的解释性推理。我们利用通过所提机制创建的数据集来训练我们的模型,并将其与现有广泛使用的检测器进行比较。我们的方法不仅增强了透明度和可定制性,还便于针对特定用例进行更好的微调。这项工作为开发毒性内容检测模型提供了一个稳健的框架,强调开放性和适应性,从而为更有效和用户特定的内容审核解决方案铺平了道路。
英文摘要:
Existing toxic detection models face significant limitations, such as lack of transparency, customization, and reproducibility. These challenges stem from the closed-source nature of their training data and the paucity of explanations for their evaluation mechanism. To address these issues, we propose a dataset creation mechanism that integrates voting and chain-of-thought processes, producing a high-quality open-source dataset for toxic content detection. Our methodology ensures diverse classification metrics for each sample and includes both classification scores and explanatory reasoning for the classifications. We utilize the dataset created through our proposed mechanism to train our model, which is then compared against existing widely-used detectors. Our approach not only enhances transparency and customizability but also facilitates better fine-tuning for specific use cases. This work contributes a robust framework for developing toxic content detection models, emphasizing openness and adaptability, thus paving the way for more effective and user-specific content moderation solutions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。