arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.00769cs.DLcs.AIcs.CL
收藏

解码AI与人类作者身份:通过自然语言处理与统计分析揭示的细微差异

Decoding AI and Human Authorship: Nuances Revealed Through NLP and Statistical Analysis

Austin Peay State University(奥斯汀佩伊州立大学);University of Arkansas at Little Rock(阿肯色大学小石城分校);American Express Company(美国运通公司)

Mayowa Akinwande, Oluwaseyi Adeliyi, Toyyibat Yussuph

AI总结:

该研究基于50万篇论文数据集,通过统计分析与自然语言处理揭示AI与人类文本在词数、词长、词汇多样性和新颖性等方面的细微差异,为理解AI创作能力及NLP发展提供见解。

摘要:

本研究探讨了AI生成的文本与人类撰写的文本之间的细微差异,旨在阐明AI和人类在语言表达方式上的不同。通过全面的统计数据分析,研究考察了人类撰写文本和AI生成文本中固有的各种语言特征、创造力模式以及潜在偏见。本研究的意义在于有助于理解AI的创造能力及其对文学、传播和社会框架的影响。通过检验一个精心构建的、包含50万篇涵盖不同主题和体裁、由大语言模型生成或由人类撰写的论文数据集,研究揭示了语言表达的更深层次,并提供了对AI和人类驱动文本创作背后认知过程的见解。分析表明,人类撰写的论文平均总词数往往高于AI生成的论文,但平均词长比AI生成的论文更短;虽然两组文本都表现出较高的流畅性,但人类撰写内容的词汇多样性高于AI生成内容。然而,AI生成的论文表现出略高的新颖性水平,这表明通过AI系统生成更具原创性内容的潜力。本文讨论了评估AI模型语言生成能力所面临的挑战,并强调了能够反映人类与AI协作写作复杂性的数据集的重要性。通过系统的预处理和严格的统计分析,本研究为AI生成内容的演变格局提供了有价值的见解,并为自然语言处理(NLP)的未来发展提供了参考。

英文摘要:

This research explores the nuanced differences in texts produced by AI and those written by humans, aiming to elucidate how language is expressed differently by AI and humans. Through comprehensive statistical data analysis, the study investigates various linguistic traits, patterns of creativity, and potential biases inherent in human-written and AI- generated texts. The significance of this research lies in its contribution to understanding AI's creative capabilities and its impact on literature, communication, and societal frameworks. By examining a meticulously curated dataset comprising 500K essays spanning diverse topics and genres, generated by LLMs, or written by humans, the study uncovers the deeper layers of linguistic expression and provides insights into the cognitive processes underlying both AI and human-driven textual compositions. The analysis revealed that human-authored essays tend to have a higher total word count on average than AI-generated essays but have a shorter average word length compared to AI- generated essays, and while both groups exhibit high levels of fluency, the vocabulary diversity of Human authored content is higher than AI generated content. However, AI- generated essays show a slightly higher level of novelty, suggesting the potential for generating more original content through AI systems. The paper addresses challenges in assessing the language generation capabilities of AI models and emphasizes the importance of datasets that reflect the complexities of human-AI collaborative writing. Through systematic preprocessing and rigorous statistical analysis, this study offers valuable insights into the evolving landscape of AI-generated content and informs future developments in natural language processing (NLP).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑