arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2504.04248eess.SYcs.AIcs.HCcs.SY
收藏

人机协同团队中联合二分类的任务负荷相关决策转介

Task load dependent decision referrals for joint binary classification in human-automation teams

Polytechnique Montreal(蒙特利尔理工学院);McGill University(麦吉尔大学);GERAD

Kesav Kaza, Jerome Le Ny, Aditya Mahajan

AI总结:

本文研究人机协同二分类任务中的最优决策转介问题,提出基于观测数据最大化期望成本降低的近视最优策略,并通过人类实验证明其显著优于不利用观测数据的盲策略。

摘要:

我们考虑在人机协同团队执行二分类任务时的最优决策转介问题。自动化系统包含一个预训练分类器,它观察一批独立任务的数据,进行分析,并可将一部分任务转介给人类操作员进行重新且最终的分析。我们的关键建模假设是,人类表现会随任务负荷的增加而下降。我们将选择转介哪些任务的问题建模为一个随机优化问题,并证明在给定任务负荷下,基于观测数据,以近视方式转介那些能使期望成本降低幅度最大的任务是最优的。这提供了一种排序方案和一种策略,用于确定最优的转介任务集。我们通过一项有人类参与者参加的实验研究,将该策略与基线进行了评估。使用雷达屏幕模拟器,参与者在时间约束下做出二分类目标分类决策。他们依据提供给他们的决策规则进行判断,但在时间压力下仍容易出错。第一个实验估计了人类表现模型参数,第二个实验比较了两种转介策略。结果表明,与一种盲策略相比,所提出的最优转介策略在统计上具有显著增益;该盲策略虽然使用了自动化和人类表现模型来确定转介,但不基于观测数据。

英文摘要:

We consider the problem of optimal decision referrals in human-automation teams performing binary classification tasks. The automation, which includes a pre-trained classifier, observes data for a batch of independent tasks, analyzes them, and may refer a subset of tasks to a human operator for fresh and final analysis. Our key modeling assumption is that human performance degrades with task load. We model the problem of choosing which tasks to refer as a stochastic optimization problem and show that, for a given task load, it is optimal to myopically refer tasks that yield the largest reduction in expected cost, conditional on the observed data. This provides a ranking scheme and a policy to determine the optimal set of tasks for referral. We evaluate this policy against a baseline through an experimental study with human participants. Using a radar screen simulator, participants made binary target classification decisions under time constraint. They were guided by a decision rule provided to them, but were still prone to errors under time pressure. An initial experiment estimated human performance model parameters, while a second experiment compared two referral policies. Results show statistically significant gains for the proposed optimal referral policy over a blind policy that determines referrals using the automation and human-performance models but not based on the observed data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑