研究偏见从程序员到程序的转移
Studying the Transfer of Biases from Programmers to Programs
AI总结:
本文通过实验与比较设计验证文化及情境隐喻会从程序员转移到程序,揭示机器偏见还可能源于程序员文化背景与编程环境。
摘要:
人们普遍认为,机器偏见的一个来源是算法所训练数据集内部的特征,即数据不足以支持泛化推断。然而,我们假设,文献中迄今尚未阐明的另一种“机制”也可能导致机器的偏见,即偏见可能源自:(i)程序员的文化背景,例如教育或工作领域;或(ii)情境化的编程环境,例如软件需求或开发者工具。结合实验与比较设计,我们研究了文化隐喻和情境隐喻的影响,并检验这些隐喻是否会从程序员“转移”到程序,从而构成机器偏见。结果表明:(i)文化隐喻会影响程序员的选择;(ii)“诱导的”情境隐喻可用于缓和或加剧文化隐喻的影响。这支持了我们的假设:自动化系统中的偏见并不总是源自机器的训练数据内部。相反,机器也可能通过文化隐喻向编程过程的转移,“复制”和“再现”来自程序员文化背景的偏见。对学术界和专业实践的启示从微观的编程层面延伸到宏观的国家监管或教育层面,并跨越软件系统运行的所有社会领域,例如流行的基于AI的自动化决策支持系统。
英文摘要:
It is generally agreed that one origin of machine bias is resulting from characteristics within the dataset on which the algorithms are trained, i.e., the data does not warrant a generalized inference. We, however, hypothesize that a different `mechanism', hitherto not articulated in the literature, may also be responsible for machine's bias, namely that biases may originate from (i) the programmers' cultural background, such as education or line of work, or (ii) the contextual programming environment, such as software requirements or developer tools. Combining an experimental and comparative design, we studied the effects of cultural metaphors and contextual metaphors, and tested whether each of these would `transfer' from the programmer to program, thus constituting a machine bias. The results show (i) that cultural metaphors influence the programmer's choices and (ii) that `induced' contextual metaphors can be used to moderate or exacerbate the effects of the cultural metaphors. This supports our hypothesis that biases in automated systems do not always originate from within the machine's training data. Instead, machines may also `replicate' and `reproduce' biases from the programmers' cultural background by the transfer of cultural metaphors into the programming process. Implications for academia and professional practice range from the micro programming-level to the macro national-regulations or educational level, and span across all societal domains where software-based systems are operating such as the popular AI-based automated decision support systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。