维持人类能动性并关注其代价:面向非母语者语言使用的生成式AI设计研究
Sustaining Human Agency, Attending to Its Cost: An Investigation into Generative AI Design for Non-Native Speakers' Language Use
AI总结:
本研究通过45组移民与母语者的MT辅助对话实验,比较三种非母语者干预方式,发现译后编辑能增强用户能动性但显著损害二人组沟通表现,为生成式AI设计提供权衡启示。
摘要:
当今的AI系统和工具能够代替人们生成类人表达,这引发了如何在AI中介的沟通中维持人类能动性的关键问题。我们在机器翻译(MT)辅助对话的背景下研究了这一问题。参与者包括45个二人组,每组由一名美国新移民和一名本地母语者组成:新移民作为非母语者利用MT进行英语信息查询,本地母语者担任信息提供者。非母语者可以通过三种方式之一影响其消息的英语产出:标注MT输出质量、在无额外提示的情况下进行常规译后编辑,或借助LLM生成提示进行增强译后编辑。数据显示,在两种译后编辑条件下,非母语者表现出更强的能动性。然而,这一益处以二人组层面沟通表现的显著下降为代价。我们从研究结果中提炼出对MT及其他生成式AI设计的启示。
英文摘要:
AI systems and tools today can generate human-like expressions on behalf of people. It raises the crucial question about how to sustain human agency in AI-mediated communication. We investigated this question in the context of machine translation (MT) assisted conversations. Our participants included 45 dyads. Each dyad consisted of one new immigrant in the United States, who leveraged MT for English information seeking as a non-native speaker, and one local native speaker, who acted as the information provider. Non-native speakers could influence the English production of their message in one of three ways: labeling the quality of MT outputs, regular post-editing without additional hints, or augmented post-editing with LLM-generated hints. Our data revealed a greater exercise of non-native speakers' agency under the two post-editing conditions. This benefit, however, came at a significant cost to the dyadic-level communication performance. We derived insights for MT and other generative AI design from our findings.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。