arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.08612cs.DC
收藏

ARcode:通过图像编码的监控数据识别HPC应用

ARcode: HPC Application Recognition Through Image-encoded Monitoring Data

Jie Li, Brandon Cook, Yong Chen

摘要:

了解作业的高性能应用,分析作业的性能行为,对系统管理和优化具有重要意义。现有的方法通过机器学习模型来检测和识别HPC应用。然而,这些方法严重依赖于从资源利用数据中手动提取的特征来实现高预测精度。在这项研究中,我们提出了一种创新的应用程序识别方法,ARcode,它编码到图像的作业监控数据,并利用自动特征学习能力的卷积神经网络来检测和识别应用程序。我们基于从大规模生产HPC系统收集的数据集进行的广泛评估表明,ARcode在高置信度阈值下的准确性方面优于最先进的方法高达18.87%。对于某些特定应用(BerkeleyGW和e3sm),ARcode在置信度阈值为0.8时的性能优于20%以上。

英文摘要:

Knowing HPC applications of jobs and analyzing their performance behavior play important roles in system management and optimizations. The existing approaches detect and identify HPC applications through machine learning models. However, these approaches rely heavily on the manually extracted features from resource utilization data to achieve high prediction accuracy. In this study, we propose an innovative application recognition method, ARcode, which encodes job monitoring data into images and leverages the automatic feature learning capability of convolutional neural networks to detect and identify applications. Our extensive evaluations based on the dataset collected from a large-scale production HPC system show that ARcode outperforms the state-of-the-art methodology by up to 18.87% in terms of accuracy at high confidence thresholds. For some specific applications (BerkeleyGW and e3sm), ARcode outperforms by over 20% at a confidence threshold of 0.8.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑