arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/0008019cs.CLcs.IRcs.LG
收藏

基于朴素贝叶斯和关键字的个人邮件反垃圾邮件过滤的实验比较

An Experimental Comparison of Naive Bayesian and Keyword-Based Anti-Spam Filtering with Personal E-mail Messages

Ion Androutsopoulos, John Koutsias, Konstantinos V. Chandrinos, Constantine D. Spyropoulos

摘要:

未经请求的大量电子邮件(也称为“垃圾邮件”)问题日益严重,因此需要可靠的反垃圾邮件过滤器。到目前为止,这种类型的过滤器主要基于手动构建的关键字模式。最近提出了一种替代方法,即自动训练朴素贝叶斯分类器来检测垃圾邮件。我们在大量的个人电子邮件信息上测试这种方法,我们以“加密”的形式公开提供这些信息,从而为标准基准做出贡献。我们引入适当的成本敏感的措施,同时调查的属性集大小,训练语料库的大小,词形化,和停止列表,在以前的实验中没有探索的问题的影响。最后,朴素贝叶斯过滤器进行了比较,在性能方面,过滤器,使用关键字模式,这是一个广泛使用的电子邮件阅读器的一部分。

英文摘要:

The growing problem of unsolicited bulk e-mail, also known as "spam", has generated a need for reliable anti-spam e-mail filters. Filters of this type have so far been based mostly on manually constructed keyword patterns. An alternative approach has recently been proposed, whereby a Naive Bayesian classifier is trained automatically to detect spam messages. We test this approach on a large collection of personal e-mail messages, which we make publicly available in "encrypted" form contributing towards standard benchmarks. We introduce appropriate cost-sensitive measures, investigating at the same time the effect of attribute-set size, training-corpus size, lemmatization, and stop lists, issues that have not been explored in previous experiments. Finally, the Naive Bayesian filter is compared, in terms of performance, to a filter that uses keyword patterns, and which is part of a widely used e-mail reader.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑