arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.08463cs.CV
收藏

一种由内存内处理支持的数据聚合可视化系统

A Data Aggregation Visualization System supported by Processing-in-Memory

Columbia University(哥伦比亚大学)

Junyoung Kim, Madhulika Balakumar, Kenneth Ross

AI总结:

本文提出DIVAN系统,通过频率归一化和分箱自动生成二维可视化,并利用内存内处理架构将大规模聚合计算速度较CPU提升45%-64%。

摘要:

聚合查询的数据可视化是进行数据探索和数据科学的最常见方式之一,因为它有助于识别数据中的相关性和模式。我们提出DIVAN,一个通过频率自动归一化一维轴以生成大量二维可视化的系统。DIVAN通过分箱对输入数据进行归一化,为数据集中出现更频繁的数据值分配更多像素。DIVAN可以利用CPU或内存内处理(PIM)架构快速计算聚合以支持可视化。在真实世界数据集上,我们展示DIVAN生成的可视化能够突出模式和相关性,其中一些是预期的,一些是意外的。通过使用PIM,我们在大数据集上计算聚合的速度比现代CPU快45%-64%。对于具有1亿行和32列的使用场景,我们的系统能够在大约一分钟内计算4,960个聚合(每个大小为128x128x128)。

英文摘要:

Data visualization of aggregation queries is one of the most common ways of doing data exploration and data science as it can help identify correlations and patterns in the data. We propose DIVAN, a system that automatically normalizes the one-dimensional axes by frequency to generate large numbers of two-dimensional visualizations. DIVAN normalizes the input data via binning to allocate more pixels to data values that appear more frequently in the dataset. DIVAN can utilize either CPUs or Processing-in-Memory (PIM) architectures to quickly calculate aggregates to support the visualizations. On real world datasets, we show that DIVAN generates visualizations that highlight patterns and correlations, some expected and some unexpected. By using PIM, we can calculate aggregates 45%-64% faster than modern CPUs on large datasets. For use cases with 100 million rows and 32 columns, our system is able to compute 4,960 aggregates (each of size 128x128x128) in about a minute.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑