arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.06751cs.DLcs.CLcs.CYcs.IR
收藏

折磨短语:科学中出现的可疑写作风格。影响现有期刊的关键问题的证据

Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals

University of Toulouse(图卢兹大学);CNRS(法国国家科学研究中心);Univ. Grenoble Alpes(格勒诺布尔阿尔卑斯大学);Grenoble INP(格勒诺布尔国立理工学院);Yandex(扬德克斯)

Guillaume Cabanac, Cyril Labbé, Alexander Magazinov

摘要:

十多年来,伪文本生成器一直被用来制作虚假的科学论文。这种无意义的论文很容易被人类和机器检测到。现在,更复杂的人工智能生成技术产生的文本与人类的文本无法区分,并且已经记录了从几个关键字生成科学文本。我们的研究引入了折磨短语的概念:意想不到的怪异短语代替了既定的短语,比如“伪造的意识”代替了“人工智能”。“我们梳理了文献,寻找折磨人的短语,并研究了一份著名的期刊,这些期刊集中在一起。假设使用先进的语言模型,我们运行了一个检测器的摘要,最近的文章,这本杂志和几个控制集。成对比较显示,该杂志中标记为“合成”的摘要集中。我们还强调其运作中的违规行为,例如编辑时间表的突然变化。我们通过分析几篇可疑的文章来证实我们的调查呼吁,强调可疑的特征:折磨人的写作风格,引用不存在的文献,以及未经承认的图像重复使用。令人惊讶的是,一些网站提供免费重写文本,生成充满折磨短语的官样文章。我们相信一些作者用重写的文本来填充他们的手稿。我们希望提高对包含通过(差)同行评审的有问题的AI生成或重写文本的出版物的认识。对合成文本的欺骗威胁着科学文献的完整性。

英文摘要:

Probabilistic text generators have been used to produce fake scientific papers for more than a decade. Such nonsensical papers are easily detected by both human and machine. Now more complex AI-powered generation techniques produce texts indistinguishable from that of humans and the generation of scientific texts from a few keywords has been documented. Our study introduces the concept of tortured phrases: unexpected weird phrases in lieu of established ones, such as 'counterfeit consciousness' instead of 'artificial intelligence.' We combed the literature for tortured phrases and study one reputable journal where these concentrated en masse. Hypothesising the use of advanced language models we ran a detector on the abstracts of recent articles of this journal and on several control sets. The pairwise comparisons reveal a concentration of abstracts flagged as 'synthetic' in the journal. We also highlight irregularities in its operation, such as abrupt changes in editorial timelines. We substantiate our call for investigation by analysing several individual dubious articles, stressing questionable features: tortured writing style, citation of non-existent literature, and unacknowledged image reuse. Surprisingly, some websites offer to rewrite texts for free, generating gobbledegook full of tortured phrases. We believe some authors used rewritten texts to pad their manuscripts. We wish to raise the awareness on publications containing such questionable AI-generated or rewritten texts that passed (poor) peer review. Deception with synthetic texts threatens the integrity of the scientific literature.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑