arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.01519cs.CLcs.LG
收藏

基于递归和迭代删除的情感分析停用词定量生成

Quantitative Stopword Generation for Sentiment Analysis via Recursive and Iterative Deletion

Daniel M. DiPietro

摘要:

停用词携带很少的语义信息,并且通常从文本数据中移除以减少数据集大小并提高机器学习模型性能。因此,研究人员一直在寻求开发用于生成有效的停用词集的技术。以前的方法从依赖于语言学专家的定性技术,到使用语料库上计算的相关性或频率相关度量来提取单词重要性的统计方法。我们提出了一种新的定量方法,采用迭代和递归的特征删除算法,看看哪些词可以从预先训练的Transformer的词汇表中删除,其性能下降最少,特别是对于情感分析的任务。从经验上讲,通过这种方法生成的停用词列表大大减少了数据集的大小,同时对模型性能的影响可以忽略不计,在一个这样的例子中,语料库缩小了28.4%,而经过训练的逻辑回归模型的准确性提高了0.25%。在另一个例子中,语料库缩小了63.7%,准确率下降了2.8%。这些令人鼓舞的结果表明,我们的方法可以为特定的NLP任务生成高效的停用词集。

英文摘要:

Stopwords carry little semantic information and are often removed from text data to reduce dataset size and improve machine learning model performance. Consequently, researchers have sought to develop techniques for generating effective stopword sets. Previous approaches have ranged from qualitative techniques relying upon linguistic experts, to statistical approaches that extract word importance using correlations or frequency-dependent metrics computed on a corpus. We present a novel quantitative approach that employs iterative and recursive feature deletion algorithms to see which words can be deleted from a pre-trained transformer's vocabulary with the least degradation to its performance, specifically for the task of sentiment analysis. Empirically, stopword lists generated via this approach drastically reduce dataset size while negligibly impacting model performance, in one such example shrinking the corpus by 28.4% while improving the accuracy of a trained logistic regression model by 0.25%. In another instance, the corpus was shrunk by 63.7% with a 2.8% decrease in accuracy. These promising results indicate that our approach can generate highly effective stopword sets for specific NLP tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑