因特网观测站和前哨站的时间相关性
Temporal Correlation of Internet Observatories and Outposts
摘要:
互联网已成为现代文明的重要组成部分,需要科学探索,类似于努力了解陆地,海洋,空气和太空环境。了解流量的基线统计分布对于科学地理解互联网至关重要。将来自不同互联网观测站和前哨站的数据关联起来,可以成为深入了解这些分布的有用工具。这项工作比较了来自最大的互联网望远镜(CAIDA暗网望远镜)和来自商业前哨(GreyNoise honeyfarm)的观测源。这两个位置都没有主动发出互联网流量,并提供对未经请求的互联网流量(主要是僵尸网络和扫描器)的不同观察。新开发的GraphBLAS超空间矩阵和D4 M关联阵列技术可以在重要尺度上有效分析这些数据。CAIDA源很好地近似于Zipf-Mandelbrot分布。在6个月的时间里,CAIDA望远镜中70%的最亮(最高频率)源始终被GreyNoise honeyfarm的同时期观测所探测到。这种重叠随着源变暗(降低频率)和观测之间的时间差增加而下降。看到CAIDA源的概率与亮度的对数成正比。时间相关性很好地描述了一个修改的柯西分布。这些观测结果与在一个月的时间尺度上漂移的源的相关高频束一致。
英文摘要:
The Internet has become a critical component of modern civilization requiring scientific exploration akin to endeavors to understand the land, sea, air, and space environments. Understanding the baseline statistical distributions of traffic are essential to the scientific understanding of the Internet. Correlating data from different Internet observatories and outposts can be a useful tool for gaining insights into these distributions. This work compares observed sources from the largest Internet telescope (the CAIDA darknet telescope) with those from a commercial outpost (the GreyNoise honeyfarm). Neither of these locations actively emit Internet traffic and provide distinct observations of unsolicited Internet traffic (primarily botnets and scanners). Newly developed GraphBLAS hyperspace matrices and D4M associative array technologies enable the efficient analysis of these data on significant scales. The CAIDA sources are well approximated by a Zipf-Mandelbrot distribution. Over a 6-month period 70\% of the brightest (highest frequency) sources in the CAIDA telescope are consistently detected by coeval observations in the GreyNoise honeyfarm. This overlap drops as the sources dim (reduce frequency) and as the time difference between the observations grows. The probability of seeing a CAIDA source is proportional to the logarithm of the brightness. The temporal correlations are well described by a modified Cauchy distribution. These observations are consistent with a correlated high frequency beam of sources that drifts on a time scale of a month.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。