arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.13544cs.HC
收藏

根据用户和任务特征调整计算机警报工具的警报阈值以改善人的决策

Improving Human Decisions by Adjusting the Alerting Thresholds for Computer Alerting Tools According to User and Task Characteristics

Marwa Gadala, Lorenzo Strigini, Peter Ayton

摘要:

目的:研究计算机报警工具支持的人类性能(正确决策的数量)是否可以通过根据用户能力和任务难度定制工具的报警阈值(灵敏度/特异性组合)来提高。背景:许多研究人员隐含地假设,对于每种工具,都存在一个理想的阈值。但研究表明,警报工具对决策错误的影响因用户能力和任务难度等变量而异。这些发现激发了我们的调查。方法:47名参与者在模拟拼写检查工具的帮助下编辑文本段落。我们通过实验操纵通道难度和工具警报阈值,测量参与者的编辑和听写能力,并计算参与者的决策错误(假阳性+假阴性)。我们调查了是否警报阈值,用户能力,任务难度和它们的相互作用影响错误计数。结果:提示阈值更好地帮助用户依赖于用户能力和通道难度之间的相互作用。有些影响是很大的:对于能力较高的用户,更敏感的阈值减少了30%的错误,在更容易的段落。参与者并不明显更喜欢他们表现得更好的警觉阈值。结论:根据个人用户的能力和任务难度调整警报阈值可以大大改善自动警报对用户决策的影响。这种可能性值得进一步研究。改进尺寸和调整规则将根据具体应用而定。应用:计算机警报工具在许多领域中发挥着关键作用。设计人员应评估可调警报阈值对于其特定CAT应用的潜在好处。为选择阈值提供指导对于在实践中实现这些效益至关重要。

英文摘要:

Objective: To investigate whether performance (number of correct decisions) of humans supported by a computer alerting tool can be improved by tailoring the tool's alerting threshold (sensitivity/specificity combination) according to user ability and task difficulty. Background: Many researchers implicitly assume that for each tool there exists a single ideal threshold. But research shows the effects of alerting tools on decision errors to vary depending on variables such as user ability and task difficulty. These findings motivated our investigation. Method: Forty-seven participants edited text passages, aided by a simulated spell-checker tool. We experimentally manipulated passage difficulty and tool alerting threshold, measured participants' editing and dictation ability, and counted participants' decision errors (false positives + false negatives). We investigated whether alerting threshold, user ability, task difficulty and their interactions affected error count. Results: Which alerting threshold better helped a user depended on an interaction between user ability and passage difficulty. Some effects were large: for higher ability users, a more sensitive threshold reduced errors by 30%, on the easier passages. Participants were not significantly more likely to prefer the alerting threshold with which they performed better. Conclusion: Adjusting alerting thresholds for individual users' ability and task difficulty could substantially improve effects of automated alerts on user decisions. This potential deserves further investigation. Improvement size and rules for adjustment will be application-specific. Application: Computer alerting tools have critical roles in many domains. Designers should assess potential benefits of adjustable alerting thresholds for their specific CAT application. Guidance for choosing thresholds will be essential for realizing these benefits in practice.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑