arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.03848cs.CL
收藏

文本分类中算法性能、词汇量和运行时间的关系研究

Exploring the Relationship Between Algorithm Performance, Vocabulary, and Run-Time in Text Classification

Brigham Young University(杨百翰大学)

Wilson Fearn, Orion Weller, Kevin Seppi

摘要:

文本分类是自然语言处理的一个重要分支,在文本分类、情感分析等领域有着广泛的应用。毫不奇怪,那些进行文本分类的人关心他们算法的运行时间,其中许多算法取决于语料库词汇表的大小,因为它们是词袋表示的。虽然许多研究已经研究了预处理技术对词汇量和准确性的影响,但没有研究这些方法如何影响模型的运行时间。为了填补这一空白,我们提供了一个全面的研究,探讨预处理技术如何影响词汇量,模型性能和模型运行时间,评估十种技术在四个模型和两个数据集。我们发现,一些单独的方法可以减少运行时间没有损失的准确性,而一些组合的方法可以贸易高达65%的减少运行时间的准确性的2-5%。此外,预处理技术的某些组合甚至可以在运行时间上减少15%,同时提高模型精度。

英文摘要:

Text classification is a significant branch of natural language processing, and has many applications including document classification and sentiment analysis. Unsurprisingly, those who do text classification are concerned with the run-time of their algorithms, many of which depend on the size of the corpus' vocabulary due to their bag-of-words representation. Although many studies have examined the effect of preprocessing techniques on vocabulary size and accuracy, none have examined how these methods affect a model's run-time. To fill this gap, we provide a comprehensive study that examines how preprocessing techniques affect the vocabulary size, model performance, and model run-time, evaluating ten techniques over four models and two datasets. We show that some individual methods can reduce run-time with no loss of accuracy, while some combinations of methods can trade 2-5% of the accuracy for up to a 65% reduction of run-time. Furthermore, some combinations of preprocessing techniques can even provide a 15% reduction in run-time while simultaneously improving model accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑