发表机构
Indian Institute of Technology Ropar（印度理工学院罗帕尔分校）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
本研究通过大规模课堂实时投票数据，发现学习者作答顺序是稳定的个体特征，且无键分布信号能标记多数错误答案，为无需答案键的教学评估提供新视角。
AI 中文摘要
课堂实时投票通常通过其答案键来解读，即参与度和正确性的计数。然而，在答案键确定之前，同一记录包含了更多信息，即谁先作答以及班级在选项之间的分布情况。这些无键信号是否稳定，以及它们揭示了什么，尚未在真实课程的规模上进行过检验。我们在一次实时部署中研究了这些信号，涉及来自约2400名学习者的47个会话中的603个投票，共340,668份提交，对每个投票读取学习者的作答顺序以及班级的分布程度。再进一步，对于有确定答案的题目，引入作者指定的答案键来解读分布情况。学习者的作答顺序是一个稳定的个体特征。其校正后的分半信度为0.92，在单个会话内为0.87，并且与学习者是否正确无关。在没有答案键的情况下阅读，大约五分之一的投票未达到明确的多数，而分布标记了使班级分裂的问题。在有确定答案的题目中，多数答案在358题中有49题是错误的。无键度量标记了其中大部分，但仅凭分布并不能将集体错误答案与单纯难题区分开来。这两种解读在很大程度上是独立的，在一个点上交汇：早期作答者仅在班级几乎已定论的题目上预测了最终的多数。两者结合，无需答案键即可描绘出会话中的学习者和问题。
英文摘要
A live classroom poll is usually read through its answer key, as a count of participation and correctness. Yet the same record holds more before any key is fixed, namely who answers early and how the class divides across the options. Whether these key-free signals are stable, and what they reveal, has not been examined at the scale of a real course. We study them in a live deployment of 340,668 submissions across 603 polls in 47 sessions from roughly 2,400 learners, reading each poll for a learner's response order and for how much the class divides. A single further step brings in the author-designated key, on items with a settled answer, to interpret the divided ones. A learner's response order is a stable individual signature. It reproduces at a corrected split-half reliability of 0.92, holds at 0.87 within single sessions, and is unrelated to whether the learner is correct. Read without a key, about one poll in five does not reach a clear majority, and division marks the questions that split the class. On the settled-answer items the majority is itself wrong on 49 of 358. The key-free measure flags most of these, though division alone does not separate a collectively wrong answer from a merely hard one. The two readings are largely independent, meeting at one point where early responders anticipate the eventual majority only on questions the class has nearly settled. Together they map the learners and questions of a session without a key.
Comments8 pages, 6 figures, Submitted to ICTIEE 2027 and currently under peer review
