arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1907.04827cs.DC
收藏

Hillview:用于大数据的万亿单元格电子表格

Hillview: A trillion-cell spreadsheet for big data

Mihai Budiu, Parikshit Gopalan, Lalith Suresh, Udi Wieder, Han Kruiger, Marcos K. Aguilera

摘要:

Hillview是一个分布式电子表格,用于浏览无法由单个机器处理的非常大的数据集。作为一个电子表格,Hillview提供了高度的交互性,允许数据分析师在多个维度上快速探索信息,同时随心所欲地切换可视化。为了提供所需的响应能力,Hillview引入了可视化草图(vizketches),作为一个简单的想法来生成紧凑的数据可视化。Vizketches将数据汇总的算法技术与计算机图形学原理相结合,以实现高效渲染。虽然简单,但vizketches通过并行计算,减少通信,提供渐进式可视化并提供精确的准确性保证来有效地扩展电子表格。使用在八台服务器上运行的Hillview,我们可以导航和可视化数百亿行和数万亿个单元格的数据集,远远超出了竞争系统的公开功能。

英文摘要:

Hillview is a distributed spreadsheet for browsing very large datasets that cannot be handled by a single machine. As a spreadsheet, Hillview provides a high degree of interactivity that permits data analysts to explore information quickly along many dimensions while switching visualizations on a whim. To provide the required responsiveness, Hillview introduces visualization sketches, or vizketches, as a simple idea to produce compact data visualizations. Vizketches combine algorithmic techniques for data summarization with computer graphics principles for efficient rendering. While simple, vizketches are effective at scaling the spreadsheet by parallelizing computation, reducing communication, providing progressive visualizations, and offering precise accuracy guarantees. Using Hillview running on eight servers, we can navigate and visualize datasets of tens of billions of rows and trillions of cells, much beyond the published capabilities of competing systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑