arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.09987cs.HC
收藏

信任搜索:揭示人类对来自Google和ChatGPT健康信息的信任

Trusting the Search: Unraveling Human Trust in Health Information from Google and ChatGPT

Xin Sun, Rongjun Ma, Xiaochang Zhao, Zhuying Li, Janne Lindqvist, Abdallah El Ali, Jos A. Bosch

AI总结:

本研究通过混合方法实验(N=21)比较用户对ChatGPT与Google健康信息的信任,发现ChatGPT信任度更高,且信任受先前知识、呈现风格和交互方式影响,凸显LLM在健康信息搜索中的潜力。

摘要:

人们越来越依赖在线来源获取健康信息,因其便利性和及时性,传统上使用Google等搜索引擎作为主要搜索代理。近年来,生成式人工智能(AI)的出现使得由大型语言模型(LLM)驱动的对话代理(如ChatGPT)成为健康信息搜索的可行替代方案。然而,尽管信任对于采纳在线健康建议至关重要,但影响人们对LLM驱动的对话代理提供的健康信息信任判断的因素仍不清楚。为解决这一问题,我们进行了一项混合方法、受试者内实验室研究(N=21),探讨在不同健康搜索任务中与不同代理(ChatGPT与Google)的互动如何影响参与者对搜索结果及搜索代理本身的信任判断。我们的主要发现显示:(a)在健康信息搜索情境中,参与者对ChatGPT的信任水平显著高于Google;(b)对健康相关信息的信任与对搜索代理的信任之间存在显著相关性,但仅对Google成立;(c)搜索任务类型不影响参与者的感知信任;(d)参与者的先前知识、信息呈现风格以及使用搜索代理的互动方式是健康相关信息信任的关键决定因素。我们的研究揭示了使用传统搜索引擎与LLM驱动的对话代理时信任感知的差异。我们强调LLM在健康相关信息搜索情境中的潜在作用,它们作为进一步搜索的跳板表现出色。我们贡献了在生成式AI时代确保有效且可靠的个人健康信息搜索的关键因素和考量。

英文摘要:

People increasingly rely on online sources for health information seeking due to their convenience and timeliness, traditionally using search engines like Google as the primary search agent. Recently, the emergence of generative Artificial Intelligence (AI) has made Large Language Model (LLM) powered conversational agents such as ChatGPT a viable alternative for health information search. However, while trust is crucial for adopting the online health advice, the factors influencing people's trust judgments in health information provided by LLM-powered conversational agents remain unclear. To address this, we conducted a mixed-methods, within-subjects lab study (N=21) to explore how interactions with different agents (ChatGPT vs. Google) across three health search tasks influence participants' trust judgments of the search results as well as the search agents themselves. Our key findings showed that: (a) participants' trust levels in ChatGPT were significantly higher than Google in the context of health information seeking; (b) there is a significant correlation between trust in health-related information and trust in the search agent, however only for Google; (c) the type of search tasks did not affect participants' perceived trust; and (d) participants' prior knowledge, the style of information presentation, and the interactive manner of using search agents were key determinants of trust in the health-related information. Our study taps into differences in trust perceptions when using traditional search engines compared to LLM-powered conversational agents. We highlight the potential role LLMs play in health-related information-seeking contexts, where they excel as stepping stones for further search. We contribute key factors and considerations for ensuring effective and reliable personal health information seeking in the age of generative AI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑