arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.16807cs.IRcs.AI
收藏

检测科学传播中LLM辅助的写作:我们做到了吗?

Detecting LLM-assisted writing in scientific communication: Are we there yet?

Ariel University(阿里埃勒大学);University College London(伦敦大学学院);Bar Ilan University(巴伊兰大学)

Teddy Lazebnik, Ariel Rosenfeld

AI总结:

针对科学传播中LLM辅助写作承认不足的问题,研究评估发现前沿LLM文本检测器表现不如识别风格突变的简单临时检测器,提出需开发专用检测工具以推动真实承认LLM参与。

摘要:

以ChatGPT为代表的大语言模型(LLM)极大地重塑了文本生成,尤其是在写作辅助领域。尽管伦理考量强调了透明承认LLM使用的重要性,特别是在科学传播中,但真实的承认行为仍然很少。鼓励准确承认LLM辅助写作的一个可行途径是使用自动化检测器。我们评估了四款前沿的LLM生成文本检测器,结果显示,与一款旨在识别LLM普及前后写作风格突变的简单临时检测器相比,它们的表现欠佳。我们认为,有必要开发专门用于LLM辅助写作检测的专用检测器。这类检测器可在促进更真实地认可LLM在科学传播中的参与方面发挥关键作用,解决当前承认实践中的挑战。

英文摘要:

Large Language Models (LLMs), exemplified by ChatGPT, have significantly reshaped text generation, particularly in the realm of writing assistance. While ethical considerations underscore the importance of transparently acknowledging LLM use, especially in scientific communication, genuine acknowledgment remains infrequent. A potential avenue to encourage accurate acknowledging of LLM-assisted writing involves employing automated detectors. Our evaluation of four cutting-edge LLM-generated text detectors reveals their suboptimal performance compared to a simple ad-hoc detector designed to identify abrupt writing style changes around the time of LLM proliferation. We contend that the development of specialized detectors exclusively dedicated to LLM-assisted writing detection is necessary. Such detectors could play a crucial role in fostering more authentic recognition of LLM involvement in scientific communication, addressing the current challenges in acknowledgment practices.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑