arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.11095cs.NI
收藏

交通监控和管理的大数据

Big Data for Traffic Monitoring and Management

Martino Trevisan

摘要:

过去二十年见证了信息和通信技术的巨大进步。除了计算能力和存储容量的提高之外,通信网络现在还承载着大量的数据,这在几年前是无法想象的。随着网络的普及,网络的复杂性也在以同样的速度增长,使得运营商和研究人员几乎没有什么工具来了解网络中以及全球范围内的互联网上发生了什么。幸运的是,数据科学和机器学习的最新进展拯救了网络分析师,并允许进行复杂程度和空间/时间范围的分析,这在10年前是不可能的。在我的论文中,我采取的角度来看,互联网服务提供商(ISP),并说明了挑战和可能性,分析来自现代运营网络的流量。我利用大数据和机器学习算法,并将其应用于来自ISP和大学校园网络的被动测量的数据集。数据科学和网络测量之间的结合由于机器学习算法的复杂性以及此类数据固有的多维性和可变性而变得复杂。因此,我的工作提出并评估了新颖的技术,灵感来自流行的机器学习方法,但经过精心定制,以适应网络流量。

英文摘要:

The last two decades witnessed tremendous advances in the Information and Communications Technologies. Beside improvements in computational power and storage capacity, communication networks carry nowadays an amount of data which was not envisaged only few years ago. Together with their pervasiveness, network complexity increased at the same pace, leaving operators and researchers with few instruments to understand what happens in the networks, and, on the global scale, on the Internet. Fortunately, recent advances in data science and machine learning come to the rescue of network analysts, and allow analyses with a level of complexity and spatial/temporal scope not possible only 10 years ago. In my thesis, I take the perspective of an Internet Service Provider (ISP), and illustrate challenges and possibilities of analyzing the traffic coming from modern operational networks. I make use of big data and machine learning algorithms, and apply them to datasets coming from passive measurements of ISP and University Campus networks. The marriage between data science and network measurements is complicated by the complexity of machine learning algorithms, and by the intrinsic multi-dimensionality and variability of this kind of data. As such, my work proposes and evaluates novel techniques, inspired from popular machine learning approaches, but carefully tailored to operate with network traffic.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑