信息搜索会话中用户知识增益的预测
Predicting User Knowledge Gain in Informational Search Sessions
摘要:
网络搜索被人们频繁地用来获取新知识和满足与学习相关的目标。在这方面,旨在获取与某一主题有关的知识的信息搜索任务十分突出。学习作为网络搜索的结果的重要性已经得到了承认。然而,缺乏对网络搜索对用户知识状态的影响的理解。如果目前针对相关性进行了优化的网络搜索引擎可以被塑造成服务于学习成果的话,预测用户的知识增益可能是向前迈出的重要一步。在本文中,我们引入了一个监督模型来预测用户的知识状态和知识增益的搜索会话期间捕获的功能。为了测量和预测用户在信息搜索会话中的知识增益,我们使用众包和精心策划的真实世界搜索会话招募了468名不同的用户,这些用户跨越11个不同的主题和信息需求。通过使用科学制定的知识测试,我们在搜索会话之前和之后校准了用户的知识,量化了他们的知识增益。我们的监督模型利用并从当前最先进的技术中获得一组全面的特征,并比较一系列特征集和特征选择策略的性能。通过我们的研究结果,我们证明了预测和分类的知识状态和使用在搜索会话中获得的功能,表现出优越的性能,在知识状态预测任务的现有基线的能力。
英文摘要:
Web search is frequently used by people to acquire new knowledge and to satisfy learning-related objectives. In this context, informational search missions with an intention to obtain knowledge pertaining to a topic are prominent. The importance of learning as an outcome of web search has been recognized. Yet, there is a lack of understanding of the impact of web search on a user's knowledge state. Predicting the knowledge gain of users can be an important step forward if web search engines that are currently optimized for relevance can be molded to serve learning outcomes. In this paper, we introduce a supervised model to predict a user's knowledge state and knowledge gain from features captured during the search sessions. To measure and predict the knowledge gain of users in informational search sessions, we recruited 468 distinct users using crowdsourcing and orchestrated real-world search sessions spanning 11 different topics and information needs. By using scientifically formulated knowledge tests, we calibrated the knowledge of users before and after their search sessions, quantifying their knowledge gain. Our supervised models utilise and derive a comprehensive set of features from the current state of the art and compare performance of a range of feature sets and feature selection strategies. Through our results, we demonstrate the ability to predict and classify the knowledge state and gain using features obtained during search sessions, exhibiting superior performance to an existing baseline in the knowledge state prediction task.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。