arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2203.05875cs.CL
收藏

利用词嵌入分析抗议新闻

Using Word Embeddings to Analyze Protests News

University of Neuchâtel(纳沙泰尔大学)

Maria Alejandra Cardoza Ceron

摘要:

CLEF 2019 ProtestNews活动的前两项任务侧重于在二元分类任务中区分抗议和非抗议相关的新闻文章和句子。在提交的文件中,选择了两个性能良好的模型,以取代现有的词嵌入word 2 vec和FastTest与ELMo和DistilBERT。与词袋或早期的向量方法不同,ELMo和DistilBERT通过基于文本中的上下文信息捕获含义来将单词表示为向量序列。在不改变除词嵌入之外的原始模型的架构的情况下,与FastText实现相比,DistilBERT的实现提高了F1-Score为0.66的性能。DistilBERT在任务和模型方面也优于ELMo。通过删除停用词和词形分析来清理数据集,已经证明,当在具有印度新闻文章的数据集上进行训练并在具有中国新闻文章的数据集上评估模型时,可以使模型在不同的上下文中更具泛化性。

英文摘要:

The first two tasks of the CLEF 2019 ProtestNews events focused on distinguishing between protest and non-protest related news articles and sentences in a binary classification task. Among the submissions, two well performing models have been chosen in order to replace the existing word embeddings word2vec and FastTest with ELMo and DistilBERT. Unlike bag of words or earlier vector approaches, ELMo and DistilBERT represent words as a sequence of vectors by capturing the meaning based on contextual information in the text. Without changing the architecture of the original models other than the word embeddings, the implementation of DistilBERT improved the performance measured on the F1-Score of 0.66 compared to the FastText implementation. DistilBERT also outperformed ELMo in both tasks and models. Cleaning the datasets by removing stopwords and lemmatizing the words has been shown to make the models more generalizable across different contexts when training on a dataset with Indian news articles and evaluating the models on a dataset with news articles from China.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑