Algorithms have been becoming increasingly relevant for various decision-making processes in the forms of Decision Support Systems or Decision-making systems in areas such as Criminal-Justice systems, Job Application Filtering, Medicine, and Healthcare to name a few. It is crucial for these algorithms to be fair and for the users to have confidence in these decisions, especially in the above contexts, because they have a high impact on society. We conduct an online empirical study with 61 participants to find out how the change in transparency and reliability of an algorithm which determines the probability of lesions being melanoma could impact users' decision-making process, as well as the confidence in the decisions made by the algorithm. The results indicate that people show at least moderate confidence in the decisions of the algorithm even when the reliability is bad. However, they would not blindly follow the algorithm's wrong decisions.
Enhancing Clinical Decision-Making: Integrating Multi-Agent Systems with Ethical AI Governance
College of Computing(计算学院);Georgia Institute of Technology(佐治亚理工学院);University of Illinois(伊利诺伊大学);Neuro Industry Research(神经产业研究);Neuro Industry, Inc.(神经产业公司)
机器学习的进步推动了在保释听证会(Feller et al. 2016),医疗诊断(Rajkomar et al. 2018; Esteva et al. 2019)和招聘(Heilweil 2019,Van Esch et al. 2019)等程序中使用AI决策算法的普及。学术文章(Floridi et al. 2018),政策文本(HLEG 2019)和普及书籍(O 'Neill 2016,Eubanks 2018)都警告说,这些算法往往是不透明的:它们不提供对其结果的解释。建立在对透明度和不透明度的因果解释以及最近关于因果解释价值的工作的基础上(Lombrozo 2011,Hitchcock 2012),我对不透明算法提出了一种道德关注,这种关注尚未在文献中得到系统的处理:当这些算法被用于改变生活的决策时,它们会阻碍我们根据自己的目标和偏好有效地塑造我们的生活,从而削弱我们的自主权我认为,这种担忧值得密切关注,因为它通过新工具和新挑战来满足算法决策透明度的要求。