AI能否像人类一样写文言文？一项受图灵测试启发的实证研究
Can AI Write Classical Chinese Poetry like Humans? An Empirical Study Inspired by Turing Test
AI总结：
本文提出受图灵测试启发的ProFTAP评估框架，验证AI具备创作与人类难以区分的文言文诗歌的能力，并发现部分开源LLMs在此任务上超越GPT-4。
摘要：
有人认为，人类的本质特征（如创造力和情感）永远无法被机器模仿。本文通过研究一个关键问题对这一观点提出质疑：AI能否像人类一样创作诗歌？为回答该问题，我们提出了ProFTAP，一个受图灵测试启发的新型评估框架，用于评估AI的诗歌创作能力。我们将其应用于当前的大型语言模型（LLMs），发现近期的LLMs确实具备创作文言文诗歌的能力，且与人类作品几乎无法区分。我们还揭示，多种开源LLMs在此任务上能超越GPT-4。
英文摘要：
Some argue that the essence of humanity, such as creativity and sentiment, can never be mimicked by machines. This paper casts doubt on this belief by studying a vital question: Can AI compose poetry as well as humans? To answer the question, we propose ProFTAP, a novel evaluation framework inspired by Turing test to assess AI's poetry writing capability. We apply it on current large language models (LLMs) and find that recent LLMs do indeed possess the ability to write classical Chinese poems nearly indistinguishable from those of humans. We also reveal that various open-source LLMs can outperform GPT-4 on this task.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
