关键性批注:通过苏格拉底提问在AI辅助写作中培养批判性思维
Critical Inker: Scaffolding Critical Thinking in AI-Assisted Writing Through Socratic Questioning
AI总结:
本文提出Critical Inker工具,通过逻辑分析和苏格拉底反馈在写作中培养批判性思维,采用苏格拉底聊天机器人和视觉反馈两种方法,评估其论证提取和逻辑有效性准确率达91.2%和87%。
摘要:
随着大型语言模型(LLMs)越来越多地自动化写作任务,用户将批判性思维委托给系统的风险日益增加。为解决这一问题,我们引入了Critical Inker,一种旨在通过逻辑分析和苏格拉底反馈在写作过程中培养批判性反思的写作工具。我们提出了两种方法:(1)一个使用问题帮助用户识别和纠正写作中逻辑错误的苏格拉底聊天机器人,以及(2)视觉反馈,该反馈在不进行对话的情况下突出文本中的逻辑错误。我们详细描述了系统的技术实现,并评估了其论证提取和逻辑有效性准确性。我们的评估显示,论证重合度为91.2%,逻辑有效性准确性为87%。最后,我们进行了小规模试点,并讨论了早期的定性结果。
英文摘要:
As Large Language Models (LLMs) increasingly automate writing tasks, there is a growing risk of cognitive deskilling where users offload critical thinking to the system. To address this, we introduce Critical Inker, a writing tool designed to scaffold critical reflection during writing through logical analysis and socratic feedback. We present two methods: (1) A Socratic chatbot using questions to help them realize and fix logical errors in their writing and (2) Visual Feedback, which highlights logical errors in the text without dialog. We detail the technical implementation of the system and evaluate its argument extraction and logical validity accuracy. Our evaluation shows a 91.2% argument overlap with ground truth argument annotations and 87% validity accuracy. Finally, we conducted a small-scale pilot and discuss early qualitative results.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。