AI-based systems have been used widely across various industries for different decisions ranging from operational decisions to tactical and strategic ones in low- and high-stakes contexts. Gradually the weaknesses and issues of these systems have been publicly reported including, ethical issues, biased decisions, unsafe outcomes, and unfair decisions, to name a few. Research has tended to optimize AI less has focused on its risk and unexpected negative consequences. Acknowledging this serious potential risks and scarcity of re-search I focus on unsafe outcomes of AI. Specifically, I explore this issue from a Human-AI interaction lens during AI deployment. It will be discussed how the interaction of individuals and AI during its deployment brings new concerns, which need a solid and holistic mitigation plan. It will be dis-cussed that only AI algorithms' safety is not enough to make its operation safe. The AI-based systems' end-users and their decision-making archetypes during collaboration with these systems should be considered during the AI risk management. Using some real-world scenarios, it will be highlighted that decision-making archetypes of users should be considered a design principle in AI-based systems.
Human vs. AI Safety Perception? Decoding Human Safety Perception with Eye-Tracking Systems, Street View Images, and Explainable AI
The University of Texas at Austin（德克萨斯大学奥斯汀分校）；Massachusetts Institute of Technology（麻省理工学院）；University of California San Diego（加利福尼亚大学圣地亚哥分校）；Norwegian University of Science and Technology（挪威科技大学）
Dialogue based Interactive Explanations for Safety Decisions in Human Robot Collaboration
Department of Civil Engineering and Management, Faculty of Science and Engineering, The University of Manchester（曼彻斯特大学科学与工程学院土木工程与管理系）；VRAIN, Universitat Politècnica de València（瓦伦西亚理工大学VRAIN研究所）；Department of Engineering, University of Cambridge（剑桥大学工程系）；Department of Mechanical and Aerospace Engineering, Faculty of Science and Engineering, The University of Manchester（曼彻斯特大学科学与工程学院机械与航空航天工程系）；Center for the Possible Futures, Kyoto Institute of Technology（京都工艺纤维大学未来可能性中心）；Institute of Industrial Science, The University of Tokyo（东京大学生产技术研究所）；Graduate School of Frontier Sciences, The University of Tokyo（东京大学新领域创成科学研究科）
A risk model and analysis method for the psychological safety of human and autonomous vehicles interaction
Capgemini Engineering（凯捷工程）；Dept. of Computer Science, University of Oxford（牛津大学计算机系）；Bristol Robotics Laboratory, University of the West of England（西英格兰大学布里斯托机器人实验室）
