发表机构
Trinity University; St. Mary's University(三一大学; 圣玛丽大学)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
本研究通过分析写作与编程过程数据,发现AI辅助具有可泛化的时间特征,能近乎完美地检测整体委托,但难以区分普通协作,为学术诚信提供过程性证据基础。
AI 中文摘要
生成式AI的快速普及使得最终产物作为学生学习证据的可靠性下降,而仅检查成品的AI检测器既不准确又引发伦理争议。过程数据提供了一种替代方案,但先前的研究仅覆盖英语论文写作。我们探究AI辅助是否带有时间特征,该特征能否从写作泛化到编程,以及能否区分普通协作与整体委托。我们分析了三个公开语料库:CoAuthor(1,447个击键级共写会话)、RealHumanEval(来自243名程序员记录的编辑器遥测数据)以及一个前LLM时代的CS1语料库(510万次击键)作为纯人类基线,比较了最小AI使用、协作式AI使用和模拟的整体委托。我们得出三项发现。第一,该特征具有泛化性:在两种媒介中,AI贡献以远超作者自身基线的突发模式出现(配对d_z = 1.13和3.54)。第二,参与度因媒介而异:93%的AI插入字符在作者的最终文档中得以保留,而仅14%的被接受代码建议完整保留。第三,仅使用可观测时间特征的分类器几乎完美地区分模拟委托与真实工作(F1 ≥ 0.997;最多0.5%的真实工作被误分类),而普通协作仍难以与无辅助工作区分。时间证据标记的是整体委托而非辅助,使过程可见性成为学术诚信的候选证据基础,有待在真实课程作业中验证。
英文摘要
The rapid adoption of generative AI has made final artifacts unreliable evidence of student learning, and AI detectors that examine only the finished product are inaccurate and ethically contentious. Process data offers an alternative, but prior work covers only English essay writing. We ask whether AI assistance carries a temporal signature, whether it generalizes from writing to programming, and whether it distinguishes ordinary collaboration from wholesale delegation. We analyze three public corpora: CoAuthor (1,447 keystroke-level co-writing sessions), RealHumanEval (editor telemetry from 243 programmer records), and a pre-LLM CS1 corpus (5.1 million keystrokes) as a human-only baseline, comparing minimal-AI work, collaborative AI use, and simulated wholesale delegation. Three findings emerge. First, the signature generalizes: AI contributions arrive in bursts far outside the author's own baseline in both mediums (paired d_z = 1.13 and 3.54). Second, engagement diverges by medium: 93% of AI-inserted characters survived to writers' final documents, while only 14% of accepted code suggestions survived intact. Third, classifiers using only observable temporal features separate simulated delegation from authentic work nearly perfectly (F1 $\geq$ 0.997; at most 0.5% of real work misclassified), while ordinary collaboration remains hard to distinguish from unassisted work. Temporal evidence flags wholesale delegation rather than assistance, positioning process visibility as a candidate evidentiary basis for academic integrity, pending validation in authentic coursework.
Comments10 pages, 4 figures, 2 tables, submitted to AHFE 2026 Hawaii Edition