arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1906.07141cs.DL
收藏

网络档案中违反HTTP Cookie的影响

Impact of HTTP Cookie Violations in Web Archives

Sawood Alam, Plinio Vargas, Michele C. Weigle, Michael L. Nelson

摘要:

某些网站上的某些HTTP Cookie可能是归档抓取中内容偏差的来源。在抓取时禁用Cookie,但在重放时不使用它们可能会导致Cookie违规,从而导致在实时网络上不存在的污损复合纪念品。为了解决这些问题,我们建议爬虫程序存储具有较短到期时间的Cookie,并且归档重放系统将Vary头中的值与URI一起考虑。

英文摘要:

Certain HTTP Cookies on certain sites can be a source of content bias in archival crawls. Accommodating Cookies at crawl time, but not utilizing them at replay time may cause cookie violations, resulting in defaced composite mementos that never existed on the live web. To address these issues, we propose that crawlers store Cookies with short expiration time and archival replay systems account for values in the Vary header along with URIs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑