使用多代理方法在高性能计算生物作业中自动化容错
Automating Fault Tolerance in High-Performance Computational Biological Jobs Using Multi-Agent Approaches
摘要:
背景资料:高性能计算系统上的大规模生物作业如果在其上执行的一个或多个计算核心发生故障则需要人工干预。这不仅增加了作业维护的成本,而且还增加了恢复作业所花费的时间以及丢失数据和作业在失败之前完成的执行的风险。可以主动检测计算核心故障并采取行动将计算核心的工作重新定位到可靠核心上的方法可以朝着自动化容错迈出重要的一步。方法:本文介绍了一种实验研究到使用多代理方法的容错。研究了两种方法,第一种是在工作一级,第二种是在核心一级。的方法进行了调查,可能会发生在计算机集群上执行并行约简算法的单核故障的情况下。第三种方法,提出了在工作和核心水平,采用多智能体技术。实验是在基因组搜索的背景下进行的,这是一种流行的计算生物学应用。测试结果:关键的结论是,所提出的方法是可行的自动化容错在高性能的计算系统,以最小的人为干预。在一个典型的实验中,其中的容错进行了研究,集中式和分散式检查点的方法平均增加90%的实际时间执行的工作。另一方面,在同一个实验中,多代理方法只增加了10%的总执行时间。
英文摘要:
Background: Large-scale biological jobs on high-performance computing systems require manual intervention if one or more computing cores on which they execute fail. This places not only a cost on the maintenance of the job, but also a cost on the time taken for reinstating the job and the risk of losing data and execution accomplished by the job before it failed. Approaches which can proactively detect computing core failures and take action to relocate the computing core's job onto reliable cores can make a significant step towards automating fault tolerance. Method: This paper describes an experimental investigation into the use of multi-agent approaches for fault tolerance. Two approaches are studied, the first at the job level and the second at the core level. The approaches are investigated for single core failure scenarios that can occur in the execution of parallel reduction algorithms on computer clusters. A third approach is proposed that incorporates multi-agent technology both at the job and core level. Experiments are pursued in the context of genome searching, a popular computational biology application. Result: The key conclusion is that the approaches proposed are feasible for automating fault tolerance in high-performance computing systems with minimal human intervention. In a typical experiment in which the fault tolerance is studied, centralised and decentralised checkpointing approaches on an average add 90% to the actual time for executing the job. On the other hand, in the same experiment the multi-agent approaches add only 10% to the overall execution time.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。