任务复杂度是否会调节实时性的益处?一项对照实验
Does Task Complexity Moderate the Benefits of Liveness? A Controlled Experiment
AI总结:
本研究针对实时编程特性益处缺乏明确实证的问题,通过37人对照实验探究任务复杂度对实时内省工具调试效率的调节作用,发现工具可显著缩短调试时间,但未证实任务复杂度的调节效应,为相关研究与环境设计提供参考。
摘要:
实时编程特性存在于各类编程环境中,从独立原型到广泛使用的环境都有涵盖。尽管实时性通常被认为是一种有用的特性,但关于实时性何时以及如何能带来益处的实证证据仍然很少。虽已有少量实验研究,但它们的结果大多没有定论。\n 我们回顾了现有实验及相关研究,收集了实时性的潜在影响及调节因素的集合。基于该集合,我们得出结论:**任务复杂度**和**使用实时性的先前经验**是以往实验中被忽略的潜在关键因素。为填补这一空白,我们设计并开展了一项对照实验(N=37),以验证以下假设:对于具备实时性使用经验的参与者,任务复杂度会调节实时内省工具对参与者调试效率的影响。\n 我们的结果并不支持任务复杂度会调节实时内省工具效果这一假设。这种不显著的调节效应可能源于参与者数量较少,因为数据本身显示存在调节效应的趋势。结果还表明,在我们的实验设置中,实时内省工具显著缩短了参与者完成任务调试的时间。\n 对于关注实时性影响的研究人员,我们的发现表明,关于实时性的研究应当有意识地选择任务复杂度以及参与者使用实时性的先前经验。对于编程环境设计者而言,我们的实验结果是迈向理解编程工具何时以及如何实现实时化以更好地帮助程序员的一步。
英文摘要:
Live programming features can be found in a range of programming environments, from individual prototypes to widely used environments. While liveness is generally considered a useful property, there is little empirical evidence on when and how liveness can be beneficial. Even though there are few experimental studies, their results are largely inconclusive. We reviewed existing experiments and related studies to gather a collection of potential effects of liveness and moderating factors. Based on this collection, we concluded that **task complexity** and **prior experience addressing liveness** are potentially essential factors neglected in previous experiments. To fill this gap, we devised and conducted a controlled experiment (N = 37) testing the hypothesis that task complexity moderates the effects of live introspection tools on participants? debugging efficiency, given participants with prior experience with liveness. Our results do not support the hypothesis that task complexity moderates the effect of live introspection tools. This non-significant moderation effect might result from the low number of participants, as the data suggests a moderation effect. The results also show that in our experiment setting, live introspection tools significantly reduced the time participants took to debug the tasks. For researchers interested in the effects of liveness, our findings suggest that studies on liveness should make conscious choices about task complexity and participants' prior experience with liveness. For designers of programming environments, the results of our experiment are a step toward understanding when and how programming tools should be live to become more helpful to programmers.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。