arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.15151cs.DC
收藏

在大数据中使用GPU进行可扩展的流量预测分析

Scalable Traffic Predictive Analysis using GPU in Big Data

Dalyapraz Dauletbak, Junghoon Heo, Sooyoung Kim, Yeon Pyo Kim, Jongwook Woo

摘要:

本文利用Spark大数据平台,在CPU和GPU上采用并行计算系统进行预测分析。交通数据集被用来预测洛杉矶县的交通拥堵。它是从美国一个流行的平台收集的,用于使用用户共享的设备信息和报告跟踪道路信息。在这个可扩展的大数据系统中,可以使用GPU和CPU来存储和处理大规模的交通数据集。本文的主要贡献是提高机器学习在基于GPU的分布式并行计算系统中的性能,以预测交通拥堵。我们表明,并行计算可以实现使用GPU和CPU与现有的Apache Spark平台。该方法也适用于不同领域的大规模数据集。过程建模以及结果使用计算时间和指标进行解释:AUC,Precision和Recall。它应该有助于智慧城市的交通管理。

英文摘要:

The paper adopts parallel computing systems for predictive analysis in both CPU and GPU leveraging Spark Big Data platform. The traffic dataset is adopted to predict the traffic jams in Los Angeles County. It is collected from a popular platform in the USA for tracking information on the road using the device information and reports shared by the users. Large-scale traffic data set can be stored and processed using both GPU and CPU in this Scalable Big Data systems. The major contribution of this paper is to improve the performance of machine learning in distributed parallel computing systems with GPU to predict the traffic congestion. We show that the parallel computing can be achieve using both GPU and CPU with the existing Apache Spark platform. Our method can be applicable to other large scale datasets in different domains. The process modeling, as well as results, are interpreted using computing time and metrics: AUC, Precision and Recall. It should help the traffic management in Smart City.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑