arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.18462cs.IR
收藏

搜索交互中的诱饵效应:用户行为理解与系统脆弱性度量

Decoy Effect In Search Interaction: Understanding User Behavior and Measuring System Vulnerability

Nuo Chen, Jiqun Liu, Hanpei Fang, Yuankai Luo, Tetsuya Sakai, Xiao-Ming Wu

AI总结:

本研究分析搜索交互中诱饵效应对用户行为的影响及调节因素,提出DEJA-VU指标度量IR系统脆弱性,为构建偏差感知的检索评估体系提供支撑。

摘要:

本研究探讨了诱饵效应在用户搜索交互中尚未被充分研究的影响,以及度量信息检索(IR)系统对该效应脆弱性的方法。研究探究了诱饵结果如何改变用户在搜索引擎结果页上的交互,重点关注点击率、浏览时长和文档感知有用性等指标。通过分析多个数据集的用户交互日志,研究表明诱饵结果会显著影响用户的行为与认知。此外,研究还考察了不同难度的任务和用户知识水平如何调节诱饵效应的影响,发现任务越简单、用户知识水平越低,对目标文档的参与度越高。在信息检索系统评估方面,研究提出了DEJA-VU指标以评估系统对诱饵效应的易感性,并在特定检索任务上进行了测试。结果显示不同系统在有效性和脆弱性上存在差异,这有助于加深我们对搜索行为中认知偏差的理解,并为构建更均衡、具备偏差意识的IR评估体系提供了方向。

英文摘要:

This study examines the decoy effect's underexplored influence on user search interactions and methods for measuring information retrieval (IR) systems' vulnerability to this effect. It explores how decoy results alter users' interactions on search engine result pages, focusing on metrics like click-through likelihood, browsing time, and perceived document usefulness. By analyzing user interaction logs from multiple datasets, the study demonstrates that decoy results significantly affect users' behavior and perceptions. Furthermore, it investigates how different levels of task difficulty and user knowledge modify the decoy effect's impact, finding that easier tasks and lower knowledge levels lead to higher engagement with target documents. In terms of IR system evaluation, the study introduces the DEJA-VU metric to assess systems' susceptibility to the decoy effect, testing it on specific retrieval tasks. The results show differences in systems' effectiveness and vulnerability, contributing to our understanding of cognitive biases in search behavior and suggesting pathways for creating more balanced and bias-aware IR evaluations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑