观点被改变:时间适应性立场分类
Opinions are Made to be Changed: Temporally Adaptive Stance Classification
摘要:
鉴于社交媒体和人们观点的快速发展,词语的使用会随着时间的推移而变化。因此,在旧文本数据上训练的分类器的性能在新数据上测试时可能会急剧下降。虽然近年来立场分类的研究取得了进展,但没有努力使这些分类器随着时间的推移具有持久的性能。为了研究这种现象,我们引入了两个新的大规模,纵向的立场数据集。然后,我们评估了随着时间的推移,立场分类器的性能持久性,并演示了它是如何衰减的训练和测试数据之间的时间差距增加。我们提出了一种新的方法来减轻这种性能下降,这是基于时间适应的词嵌入用于训练的立场分类。这使我们能够利用当前时间段内现成的未标记数据,而不是昂贵的注释工作。我们提出并比较了几种嵌入自适应的方法,发现增量时间对齐(ITA)模型在降低性能随时间的下降方面效果最好。
英文摘要:
Given the rapidly evolving nature of social media and people's views, word usage changes over time. Consequently, the performance of a classifier trained on old textual data can drop dramatically when tested on newer data. While research in stance classification has advanced in recent years, no effort has been invested in making these classifiers have persistent performance over time. To study this phenomenon we introduce two novel large-scale, longitudinal stance datasets. We then evaluate the performance persistence of stance classifiers over time and demonstrate how it decays as the temporal gap between training and testing data increases. We propose a novel approach to mitigate this performance drop, which is based on temporal adaptation of the word embeddings used for training the stance classifier. This enables us to make use of readily available unlabelled data from the current time period instead of expensive annotation efforts. We propose and compare several approaches to embedding adaptation and find that the Incremental Temporal Alignment (ITA) model leads to the best results in reducing performance drop over time.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。