arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.04070cs.DL
收藏

介绍一个暗网归档框架

Introducing A Dark Web Archival Framework

Justin F. Brunelle, Ryan Farley, Grant Atkins, Trevor Bostic, Marites Hendrix, Zak Zebrowski

摘要:

我们提出了一个暗网网络规模存档的框架。虽然通常与非法和非法活动有关,但暗网提供了一种私下访问网络信息的方式。对于全球公民来说,这是一个有价值的、对社会有益的工具,例如那些希望在限制信息可用性的压迫性政治制度下获得信息的人。然而,暗网上几乎没有进行机构存档(仅限于Archive.is暗网存在,一次一页的存档)。我们使用表面网络工具,技术和程序(TTP),并将其用于归档暗网。我们证明了我们的框架的可行性,在一个概念验证和狭窄的范围内的原型,实现了以下轻度适应的开源工具:Brozzler爬虫捕获,WARC文件存储,和python重放。使用这些工具,我们证明了修改后的表面网络存档TTP存档暗网的可行性。

英文摘要:

We present a framework for web-scale archiving of the dark web. While commonly associated with illicit and illegal activity, the dark web provides a way to privately access web information. This is a valuable and socially beneficial tool to global citizens, such as those wishing to access information while under oppressive political regimes that work to limit information availability. However, little institutional archiving is performed on the dark web (limited to the Archive.is dark web presence, a page-at-a-time archiver). We use surface web tools, techniques, and procedures (TTPs) and adapt them for archiving the dark web. We demonstrate the viability of our framework in a proof-of-concept and narrowly scoped prototype, implemented with the following lightly adapted open source tools: the Brozzler crawler for capture, WARC file for storage, and pywb for replay. Using these tools, we demonstrate the viability of modified surface web archiving TTPs for archiving the dark web.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑