BugDoc:计算过程的优化算法
BugDoc: Algorithms to Debug Computational Processes
摘要:
科学实验和企业的数据分析、大规模模拟和机器学习任务都需要使用复杂的计算管道来得出定量和定性的结论。如果管道中的某些活动产生错误的输出,则管道可能无法执行或产生不正确的结果。推断这种故障的根本原因是具有挑战性的,通常需要时间和大量的人类思考,同时仍然容易出错。我们提出了一种新的方法,利用迭代和出处自动推断的根本原因,并得出简洁的解释失败。通过详细的实验评估,我们评估了与最先进技术相比我们方法的成本、精确度和召回率。我们的实验数据和处理软件可供使用、可重复性和增强。
英文摘要:
Data analysis for scientific experiments and enterprises, large-scale simulations, and machine learning tasks all entail the use of complex computational pipelines to reach quantitative and qualitative conclusions. If some of the activities in a pipeline produce erroneous outputs, the pipeline may fail to execute or produce incorrect results. Inferring the root cause(s) of such failures is challenging, usually requiring time and much human thought, while still being error-prone. We propose a new approach that makes use of iteration and provenance to automatically infer the root causes and derive succinct explanations of failures. Through a detailed experimental evaluation, we assess the cost, precision, and recall of our approach compared to the state of the art. Our experimental data and processing software is available for use, reproducibility, and enhancement.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。