arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.12558cs.HC
收藏

Just Like Me: 主观决策中意见与个人经历在解释感知中的作用

Just Like Me: The Role of Opinions and Personal Experiences in The Perception of Explanations in Subjective Decision-Making

Sharon Ferguson, Paula Akemi Aoyagui, Young-Ho Kim, Anastasia Kuzminykh

AI总结:

本研究通过访谈(N=20)发现,在主观决策中,AI生成的包含与用户自身意见和经历一致内容的解释更具说服力和可信度,并讨论了确认偏误及伦理挑战。

摘要:

随着大型语言模型(LLM)在某些情境下能够生成类似人类的论证,适用于人机协作的场景数量不断增加。具体而言,我们关注主观决策,即决策具有情境性、可解释性,并基于个人的信念和价值观。在这种情况下,拥有多种论证和视角可能对决策者特别有用。我们以网络上的隐性性别歧视为主观决策的一个未被充分研究的应用场景,提出LLM输出可以有效提供多样化的论证,以丰富人类的主观决策。为评估该案例的适用性,我们进行了一项访谈研究(N=20),参与者评估了针对互联网上隐性性别歧视实例生成的人类和AI生成解释文本的感知作者身份、相关性、说服力和可信度。在本研讨会论文中,我们聚焦于结果中一个与LLM论证中展示的意见和经历相关的令人担忧的趋势。我们发现,参与者对包含这些特征的解释评价为更具说服力和可信度,尤其是当这些意见和经历与参与者自身的意见和经历一致时。我们描述了我们的发现,讨论了确认偏误所扮演的令人担忧的角色,并提请关注围绕AI生成类人经历所引发的伦理挑战。

英文摘要:

As large language models (LLMs) advance to produce human-like arguments in some contexts, the number of settings applicable for human-AI collaboration broadens. Specifically, we focus on subjective decision-making, where a decision is contextual, open to interpretation, and based on one's beliefs and values. In such cases, having multiple arguments and perspectives might be particularly useful for the decision-maker. Using subtle sexism online as an understudied application of subjective decision-making, we suggest that LLM output could effectively provide diverse argumentation to enrich subjective human decision-making. To evaluate the applicability of this case, we conducted an interview study (N=20) where participants evaluated the perceived authorship, relevance, convincingness, and trustworthiness of human and AI-generated explanation-text, generated in response to instances of subtle sexism from the internet. In this workshop paper, we focus on one troubling trend in our results related to opinions and experiences displayed in LLM argumentation. We found that participants rated explanations that contained these characteristics as more convincing and trustworthy, particularly so when those opinions and experiences aligned with their own opinions and experiences. We describe our findings, discuss the troubling role that confirmation bias plays, and bring attention to the ethical challenges surrounding the AI generation of human-like experiences.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑