利用小众众包与AI数据增强从非结构化数据中挖掘支持与反对疫苗接种的理由
Mining Reasons For And Against Vaccination From Unstructured Data Using Nichesourcing and AI Data Augmentation
AI总结:
本文构建并公开RFAV数据集,结合小众众包标注与GPT4、GPT3.5-Turbo数据增强,在非结构化文本中挖掘支持与反对疫苗接种的理由及其科学权威依据,并验证了人工增强数据对模型训练的影响。
摘要:
我们提出了“支持与反对疫苗接种的理由”(RFAV)数据集,用于预测支持与反对疫苗接种的理由以及用于论证这些理由的科学权威来源。该数据集通过小众众包(nichesourcing)进行标注,并使用GPT4和GPT3.5-Turbo进行数据增强。我们展示了尽管任务涉及高度主观性,仍可在不同任务定义下从非结构化文本中挖掘这些理由,并探索了使用GPT4和GPT3.5-Turbo进行上下文学习的人工增强数据的影响。我们公开了该数据集、训练后的模型以及用于训练标注者和定义任务的标注手册。
英文摘要:
We present Reasons For and Against Vaccination (RFAV), a dataset for predicting reasons for and against vaccination, and scientific authorities used to justify them, annotated through nichesourcing and augmented using GPT4 and GPT3.5-Turbo. We show how it is possible to mine these reasons in non-structured text, under different task definitions, despite the high level of subjectivity involved and explore the impact of artificially augmented data using in-context learning with GPT4 and GPT3.5-Turbo. We publish the dataset and the trained models along with the annotation manual used to train annotators and define the task.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。