arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1805.10260cs.DL
收藏

为档案种子刮擦SERP:当你开始时很重要

Scraping SERPs for Archival Seeds: It Matters When You Start

Alexander C. Nwala, Michele C. Weigle, Michael L. Nelson

摘要:

基于事件的收藏通常是从网络搜索开始的,但您在第1天找到的搜索结果可能与第7天找到的搜索结果不同。在本文中,我们认为,起源于提取URI(统一资源标识符)从搜索引擎结果页面(SERP)的集合。具体来说,我们试图提供洞察力的检索的新闻故事在谷歌上找到的URI,并回答两个主要问题:第一,可以“重新找到”相同的URI的新闻故事(同一查询)从谷歌在给定的时间后?第二,在给定的时间段内,在谷歌上找到一个故事的概率是多少?为了回答这些问题,我们在七个多月的时间里(2017-05-25到2018-01-12)每天向Google发出七个查询,并从前五个SERP中收集链接,为每个查询生成七个集合。这些查询代表了公共利益故事:“医疗保健法案”、“曼彻斯特爆炸案”、“伦敦恐怖主义”、“特朗普俄罗斯”、“旅行禁令”、“哈维飓风”和“厄玛飓风”。“我们随着时间的推移跟踪了所有集合中的每个URI,以估计前五个SERP中URI的可重复性。我们的研究结果显示,默认的Google SERP上的每日平均故事替换率范围为0.21 - 0.54,每周为0.39 - 0.79,这表明较旧的故事被较新的故事快速替换。从最初出现在SERP上的一天后找到新闻故事的相同URI的概率范围为0.34 - 0.44。一周后,找到相同新闻故事的概率迅速下降到0.01 - 0.11。我们的研究结果表明,由于难以从谷歌检索新闻故事的URI,来源于搜索引擎的收集建设应尽快开始,以捕捉事件的第一阶段,并应坚持以捕捉事件的演变.

英文摘要:

Event-based collections are often started with a web search, but the search results you find on Day 1 may not be the same as those you find on Day 7. In this paper, we consider collections that originate from extracting URIs (Uniform Resource Identifiers) from Search Engine Result Pages (SERPs). Specifically, we seek to provide insight about the retrievability of URIs of news stories found on Google, and to answer two main questions: first, can one "refind" the same URI of a news story (for the same query) from Google after a given time? Second, what is the probability of finding a story on Google over a given period of time? To answer these questions, we issued seven queries to Google every day for over seven months (2017-05-25 to 2018-01-12) and collected links from the first five SERPs to generate seven collections for each query. The queries represent public interest stories: "healthcare bill," "manchester bombing," "london terrorism," "trump russia," "travel ban," "hurricane harvey," and "hurricane irma." We tracked each URI in all collections over time to estimate the discoverability of URIs from the first five SERPs. Our results showed that the daily average rate at which stories were replaced on the default Google SERP ranged from 0.21 -0.54, and a weekly rate of 0.39 - 0.79, suggesting the fast replacement of older stories by newer stories. The probability of finding the same URI of a news story after one day from the initial appearance on the SERP ranged from 0.34 - 0.44. After a week, the probability of finding the same news stories diminishes rapidly to 0.01 - 0.11. Our findings suggest that due to the difficulty in retrieving the URIs of news stories from Google, collection building that originates from search engines should begin as soon as possible in order to capture the first stages of events, and should persist in order to capture the evolution of the events...

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑