arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2211.05985cs.CLcs.AIcs.LG
收藏

利用说服性写作策略解释和检测健康错误信息

Using Persuasive Writing Strategies to Explain and Detect Health Misinformation

Michigan State University(密歇根州立大学);Ohio State University(俄亥俄州立大学)

Danial Kamali, Joseph Romain, Huiyi Liu, Wei Peng, Jingbo Meng, Parisa Kordjamshidi

AI总结:

本文提出说服性写作策略标注方案与专家标注的健康错误信息数据集,并利用 BERT、GPT 模型验证策略标签可提升检测准确率和可解释性。

摘要:

如今,错误信息的传播是社会中的一个突出问题。我们的研究聚焦于通过分析文本文档中采用的说服策略,辅助自动识别错误信息。为实现这一目标,我们提出了一种涵盖常见说服性写作手法的新型标注方案。此外,我们还提供了一个健康错误信息数据集,由专家使用我们提出的方案进行了详尽标注。我们的贡献包括提出一项新任务:为文本片段标注其说服性写作策略类型。我们将说服策略作为额外信息来源,评估了 BERT 系列预训练语言模型以及 GPT 系列生成式大型语言模型的微调和提示工程技术。我们评估了在错误信息检测场景中将说服策略用作中间标签的效果。结果表明,这些策略提高了准确率,并增强了错误信息检测模型的可解释性。说服策略可作为有价值的洞察和解释,使其他模型甚至人类能够就信息的可信度作出更明智的判断。

英文摘要:

Nowadays, the spread of misinformation is a prominent problem in society. Our research focuses on aiding the automatic identification of misinformation by analyzing the persuasive strategies employed in textual documents. We introduce a novel annotation scheme encompassing common persuasive writing tactics to achieve our objective. Additionally, we provide a dataset on health misinformation, thoroughly annotated by experts utilizing our proposed scheme. Our contribution includes proposing a new task of annotating pieces of text with their persuasive writing strategy types. We evaluate fine-tuning and prompt-engineering techniques with pre-trained language models of the BERT family and the generative large language models of the GPT family using persuasive strategies as an additional source of information. We evaluate the effects of employing persuasive strategies as intermediate labels in the context of misinformation detection. Our results show that those strategies enhance accuracy and improve the explainability of misinformation detection models. The persuasive strategies can serve as valuable insights and explanations, enabling other models or even humans to make more informed decisions regarding the trustworthiness of the information.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑