ChatGPT与Google：搜索性能与用户体验的比较研究
ChatGPT vs. Google: A Comparative Study of Search Performance and User Experience
AI总结：
本研究通过随机在线实验比较ChatGPT与Google Search在信息查找任务中的表现，发现ChatGPT耗时更少、用户体验更佳且能拉平教育水平差异，但在事实核查上较弱，为搜索引擎整合聊天机器人技术提供了见解。
摘要：
ChatGPT，一种基于大型语言模型的聊天机器人，其出现引发了关于其对传统搜索引擎潜在影响的疑问。在本研究中，我们调查了用户在信息查找任务中使用搜索引擎和聊天机器人工具时的行为差异。我们进行了一项随机在线实验，将参与者分为两组：一组使用类似ChatGPT的工具，另一组使用类似Google Search的工具。我们的发现表明，ChatGPT组在所有任务上花费的时间始终更少，而两组之间的整体任务表现没有显著差异。值得注意的是，ChatGPT拉平了不同教育水平之间的用户搜索表现差异，在回答直接问题和提供通用解决方案方面表现出色，但在事实核查任务上表现不足。用户认为ChatGPT的响应比Google Search具有更高的信息质量，尽管对两种工具表现出相似的信任水平。此外，使用ChatGPT的参与者在有用性、享受感和满意度方面报告了显著更好的用户体验，而感知易用性在两种工具之间保持相当。然而，ChatGPT也可能导致过度依赖，并生成或复制错误信息，产生不一致的结果。我们的研究为搜索引擎管理提供了有价值的见解，并突出了将聊天机器人技术整合到搜索引擎设计中的机会。
英文摘要：
The advent of ChatGPT, a large language model-powered chatbot, has prompted questions about its potential implications for traditional search engines. In this study, we investigate the differences in user behavior when employing search engines and chatbot tools for information-seeking tasks. We carry out a randomized online experiment, dividing participants into two groups: one using a ChatGPT-like tool and the other using a Google Search-like tool. Our findings reveal that the ChatGPT group consistently spends less time on all tasks, with no significant difference in overall task performance between the groups. Notably, ChatGPT levels user search performance across different education levels and excels in answering straightforward questions and providing general solutions but falls short in fact-checking tasks. Users perceive ChatGPT's responses as having higher information quality compared to Google Search, despite displaying a similar level of trust in both tools. Furthermore, participants using ChatGPT report significantly better user experiences in terms of usefulness, enjoyment, and satisfaction, while perceived ease of use remains comparable between the two tools. However, ChatGPT may also lead to overreliance and generate or replicate misinformation, yielding inconsistent results. Our study offers valuable insights for search engine management and highlights opportunities for integrating chatbot technologies into search engine designs.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
