arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2206.02443cs.CRcs.LG
收藏

使用BERT进行垃圾信息检测

Spam Detection Using BERT

Islamic University of Gaza(加沙伊斯兰大学)

Thaer Sahmoud, Mohammad Mikki

AI总结:

本文提出基于BERT预训练模型的垃圾信息检测方法,利用多个公开语料库训练并在四个数据集上分别取得98.62%、97.83%、99.13%和99.28%的检测性能。

摘要:

电子邮件和短信是当今通信中最流行的工具,随着电子邮件和短信用户数量的增加,垃圾信息的数量也在增加。垃圾信息是指任何未经请求、批量发送的不需要的数字通信,垃圾邮件和垃圾短信通过不必要地淹没网络链路,造成了严重的资源浪费。尽管大多数垃圾邮件来自试图推销产品的广告商,但有些邮件的意图更为恶意,例如钓鱼邮件,其目的是诱骗受害者泄露敏感信息,如网站登录凭据或信用卡信息,这类网络犯罪被称为网络钓鱼。为了应对垃圾信息,许多研究和努力致力于构建垃圾信息检测器,能够将消息和邮件过滤为垃圾信息或正常信息。在本研究中,我们使用BERT预训练模型构建了一个垃圾信息检测器,通过理解邮件和消息的上下文对其进行分类,并使用多个语料库训练了我们的垃圾信息检测器模型,包括SMS collection语料库、Enron语料库、SpamAssassin语料库、Ling-Spam语料库和SMS spam collection语料库,我们的垃圾信息检测器性能分别达到98.62%、97.83%、99.13%和99.28%。关键词:垃圾信息检测器,BERT,机器学习,自然语言处理,Transformer,Enron语料库,SpamAssassin语料库,SMS垃圾信息检测语料库,Ling-Spam语料库。

英文摘要:

Emails and SMSs are the most popular tools in today communications, and as the increase of emails and SMSs users are increase, the number of spams is also increases. Spam is any kind of unwanted, unsolicited digital communication that gets sent out in bulk, spam emails and SMSs are causing major resource wastage by unnecessarily flooding the network links. Although most spam mail originate with advertisers looking to push their products, some are much more malicious in their intent like phishing emails that aims to trick victims into giving up sensitive information like website logins or credit card information this type of cybercrime is known as phishing. To countermeasure spams, many researches and efforts are done to build spam detectors that are able to filter out messages and emails as spam or ham. In this research we build a spam detector using BERT pre-trained model that classifies emails and messages by understanding to their context, and we trained our spam detector model using multiple corpuses like SMS collection corpus, Enron corpus, SpamAssassin corpus, Ling-Spam corpus and SMS spam collection corpus, our spam detector performance was 98.62%, 97.83%, 99.13% and 99.28% respectively. Keywords: Spam Detector, BERT, Machine learning, NLP, Transformer, Enron Corpus, SpamAssassin Corpus, SMS Spam Detection Corpus, Ling-Spam Corpus.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑