计算机生成文本的自动检测
Algorithmic Detection of Computer Generated Text
摘要:
计算机生成的学术论文已经被用来在几个计算机科学会议上暴露缺乏彻底的人类审查。我们评估这类文件的分类问题。在识别和评估学术论文的几个可量化的特征之后,我们应用机器学习的方法来构建一个二元分类器。在对200篇论文的测试中,所得到的分类器正确地将论文标记为人类撰写的或计算机生成的,没有将计算机生成的论文错误分类为人类,并且将人类论文错误分类为计算机生成的错误分类率为2%。我们相信这些特征的推广适用于类似的分类问题。虽然目前大多数基于文本的垃圾邮件检测技术都集中在基于关键字的电子邮件信息分类上,但新一代未经请求的计算机生成的广告伪装成在线群组、留言板和社交新闻网站中的合法帖子。我们的研究结果表明,考虑到这些环境提供的格式和上下文线索可能是至关重要的选择功能时,以确定这些不需要的帖子。
英文摘要:
Computer generated academic papers have been used to expose a lack of thorough human review at several computer science conferences. We assess the problem of classifying such documents. After identifying and evaluating several quantifiable features of academic papers, we apply methods from machine learning to build a binary classifier. In tests with two hundred papers, the resulting classifier correctly labeled papers either as human written or as computer generated with no false classifications of computer generated papers as human and a 2% false classification rate for human papers as computer generated. We believe generalizations of these features are applicable to similar classification problems. While most current text-based spam detection techniques focus on the keyword-based classification of email messages, a new generation of unsolicited computer-generated advertisements masquerade as legitimate postings in online groups, message boards and social news sites. Our results show that taking the formatting and contextual clues offered by these environments into account may be of central importance when selecting features with which to identify such unwanted postings.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。