探索交互-结果悖论:与LLM更丰富、更具自我意识的交互可能尚未带来更好的学习效果
Exploring The Interaction-Outcome Paradox: Seemingly Richer and More Self-Aware Interactions with LLMs May Not Yet Lead to Better Learning
AI总结:
针对LLM虽能带来更丰富、更具自我意识的学习交互却未提升学习成果的“交互-结果悖论”,通过受控研究(N=20)比较LLM与搜索界面,提出认知转变概念解释该现象,为教育技术评估提供新视角。
摘要:
虽然大型语言模型(LLM)已改变学习用户界面,从关键词搜索转向自然语言对话,但其对教育成果的影响仍不明确。我们开展了一项受控研究(N=20),直接比较LLM与基于搜索的界面之间的学习交互和结果。研究发现,尽管LLM能引发学习者更丰富、更细致的交互,但并未产生普遍更好的学习成果。本文探讨了这种“交互-结果悖论”。为解释这一点,我们讨论了认知转变的概念:学生努力的焦点从查找和综合不同来源(搜索)转向更具自我意识地识别和表达知识差距及弥合差距的策略(LLM)。这一见解为评估教育技术提供了新视角,表明学习工具的未来不在于简单丰富交互,而在于设计能利用学生表达能力来支撑有效认知工作的系统。
英文摘要:
While Large Language Models (LLMs) have transformed the user interface for learning, moving from keyword search to natural language dialogue, their impact on educational outcomes remains unclear. We present a controlled study (N=20) that directly compares the learning interaction and outcomes between LLM and search-based interfaces. We found that although LLMs elicit richer and nuanced interactions from a learner, they do not produce broadly better learning outcomes. In this paper, we explore this the ``Interaction-Outcome Paradox.'' To explain this, we discuss the concept of a cognitive shift: the locus of student effort moves from finding and synthesizing disparate sources (search) to a more self-aware identification and articulation of their knowledge gaps and strategies to bridge those gaps (LLMs). This insight provides a new lens for evaluating educational technologies, suggesting that the future of learning tools lies not in simply enriching interaction, but in designing systems that scaffold productive cognitive work by leveraging this student expressiveness.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。