解析安全关键行业中的人机交互:一项系统性文献综述
Unpacking Human-AI Interaction in Safety-Critical Industries: A Systematic Literature Review
AI总结:
本文系统综述安全关键行业的HAII文献,梳理术语、AI角色、影响因素与测量方式,发现术语不一、研究碎片化,并提出统一术语、全生命周期纳入用户及场景化设计建议。
摘要:
确保安全关键行业中高质量的人机交互(HAII)至关重要。未能做到这一点可能导致灾难性和致命后果。尽管这一问题十分紧迫,但现有关于HAII的研究仍然有限、分散且不一致。我们在此对相关文献进行了综述,并提出了有助于改进该领域的研究最佳实践建议。我们将调查分为以下领域:1)用于描述HAII的术语,2)AI赋能系统的主要角色,3)影响HAII的因素,以及4)HAII的测量方式。此外,我们还描述了这些文章所讨论的、用于安全关键行业的AI赋能系统的能力与成熟度。我们发现,文献中没有使用单一术语来描述HAII,而且某些术语具有多种含义。根据所审文献,影响HAII的因素有七类:用户特征(如用户人格)、用户感知与态度(如用户偏见)、用户期望与经验(如不匹配的用户期望和经验)、AI界面与功能(如交互设计)、AI输出(如感知准确性)、可解释性与可诠释性(如细节程度、用户理解),以及AI的使用(如环境异质性)。HAII最常通过与用户相关的主观指标来测量(如用户感知、信任和态度),而AI辅助决策是AI赋能系统最常见的主要角色。基于本次综述,我们得出结论:HAII研究存在重大空白。研究人员和开发者需要规范HAII术语,让用户参与AI整个生命周期(尤其是开发阶段),并使安全关键行业中的HAII适配用户和环境。
英文摘要:
Ensuring quality human-AI interaction (HAII) in safety-critical industries is essential. Failure to do so can lead to catastrophic and deadly consequences. Despite this urgency, existing research on HAII is limited, fragmented, and inconsistent. We present here a survey of that literature and recommendations for research best practices that should improve the field. We divided our investigation into the following areas: 1) terms used to describe HAII, 2) primary roles of AI-enabled systems, 3) factors that influence HAII, and 4) how HAII is measured. Additionally, we described the capabilities and maturity of the AI-enabled systems used in safety-critical industries discussed in these articles. We found that no single term is used across the literature to describe HAII and some terms have multiple meanings. According to our literature, seven factors influence HAII: user characteristics (e.g., user personality), user perceptions and attitudes (e.g., user biases), user expectations and experience (e.g., mismatched user expectations and experience), AI interface and features (e.g., interactive design), AI output (e.g., perceived accuracy), explainability and interpretability (e.g., level of detail, user understanding), and usage of AI (e.g., heterogeneity of environments). HAII is most measured with user-related subjective metrics (e.g., user perceptions, trust, and attitudes), and AI-assisted decision-making is the most common primary role of AI-enabled systems. Based on this review, we conclude that there are substantial research gaps in HAII. Researchers and developers need to codify HAII terminology, involve users throughout the AI lifecycle (especially during development), and tailor HAII in safety-critical industries to the users and environments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。