arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.03702cs.SIcs.CY
收藏

媒体云:开放网络上全球新闻的大规模开源集合

Media Cloud: Massive Open Source Collection of Global News on the Open Web

Hal Roberts, Rahul Bhargava, Linas Valiukas, Dennis Jen, Momin M. Malik, Cindy Bishop, Emily Ndulue, Aashka Dave, Justin Clark, Bruce Etling, Rob Faris, Anushka… 展开作者

Hal Roberts, Rahul Bhargava, Linas Valiukas, Dennis Jen, Momin M. Malik, Cindy Bishop, Emily Ndulue, Aashka Dave, Justin Clark, Bruce Etling, Rob Faris, Anushka Shah, Jasmin Rubinovitz, Alexis Hope, Catherine D'Ignazio, Fernando Bermejo, Yochai Benkler, Ethan Zuckerman

摘要:

我们首次完整描述了Media Cloud,这是一个基于爬行超链接结构的开源平台,已运行10多年,对于许多用途来说,它将是收集数据以研究开放网络上媒体生态系统的最佳方式。我们记录了Media Cloud收集和存储哪些数据的关键选择,它如何处理和组织这些数据,以及它的开放API访问和面向用户的工具。我们还强调了媒体云收集策略与相关替代方案相比的优势和局限性。我们概述了使用Media Cloud生成的两个样本数据集,并讨论了研究人员如何使用该平台创建自己的数据集。

英文摘要:

We present the first full description of Media Cloud, an open source platform based on crawling hyperlink structure in operation for over 10 years, that for many uses will be the best way to collect data for studying the media ecosystem on the open web. We document the key choices behind what data Media Cloud collects and stores, how it processes and organizes these data, and its open API access as well as user-facing tools. We also highlight the strengths and limitations of the Media Cloud collection strategy compared to relevant alternatives. We give an overview two sample datasets generated using Media Cloud and discuss how researchers can use the platform to create their own datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑