arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2010.09078cs.CL
收藏

将基于计数的特征转化为预训练模型以改进姿态检测

Incorporating Count-Based Features into Pre-Trained Models for Improved Stance Detection

University of Birmingham(伯明翰大学);School of Computer Science(计算机学院);United Kingdom(英国)

Anushka Prakash, Harish Tayyar Madabushi

摘要:

社交媒体的爆炸性增长和普及彻底改变了我们沟通和协作的方式。不幸的是,这种获取和分享信息的便利导致了错误信息和宣传的爆炸。鉴于姿态检测可以显著帮助准确性预测,这项工作的重点是提高自动姿态检测,这是一项预先训练的模型非常成功的任务,就像其他几项任务一样。这项工作表明,立场检测的任务可以受益于基于特征的信息,特别是在某些表现不佳的类,然而,使用集成将这些特征集成到预先训练的模型中是具有挑战性的。我们提出了一种新的架构,用于将特征与预训练模型集成,以解决这些挑战,并在RumourEval 2019数据集上测试我们的方法。该方法在测试集上获得了最先进的结果,F1得分为63.94。

英文摘要:

The explosive growth and popularity of Social Media has revolutionised the way we communicate and collaborate. Unfortunately, this same ease of accessing and sharing information has led to an explosion of misinformation and propaganda. Given that stance detection can significantly aid in veracity prediction, this work focuses on boosting automated stance detection, a task on which pre-trained models have been extremely successful on, as on several other tasks. This work shows that the task of stance detection can benefit from feature based information, especially on certain under performing classes, however, integrating such features into pre-trained models using ensembling is challenging. We propose a novel architecture for integrating features with pre-trained models that address these challenges and test our method on the RumourEval 2019 dataset. This method achieves state-of-the-art results with an F1-score of 63.94 on the test set.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑