机器学习失败指南:从基础到实践的可靠性与鲁棒性
A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practice
AI总结:
本文为从业者提供理解机器学习模型失败的指南,从第一性原理区分缺乏可靠性与鲁棒性导致的失败,并总结理论概念、分析技术及其实际应用示例。
摘要:
采用机器学习(ML)的主要障碍之一是ML模型会意外失败。在本研究中,我们旨在为从业者提供一份指南,帮助他们更好地理解ML模型为何失败,并为其配备可用于分析失败的技术。具体而言,我们将失败讨论为由缺乏可靠性或缺乏鲁棒性引起。以这种方式区分失败原因使我们能够从第一性原理正式定义模型失败的原因,并将这些定义与工程概念和现实世界的部署设置联系起来。在整篇文档中,我们提供了:1)可靠性与鲁棒性的重要理论概念总结;2)从业者可用于分析ML模型可靠性和鲁棒性的现有技术抽样;3)展示这些概念和技术如何应用于现实世界设置的示例。
英文摘要:
One of the main barriers to adoption of Machine Learning (ML) is that ML models can fail unexpectedly. In this work, we aim to provide practitioners a guide to better understand why ML models fail and equip them with techniques they can use to reason about failure. Specifically, we discuss failure as either being caused by lack of reliability or lack of robustness. Differentiating the causes of failure in this way allows us to formally define why models fail from first principles and tie these definitions to engineering concepts and real-world deployment settings. Throughout the document we provide 1) a summary of important theoretic concepts in reliability and robustness, 2) a sampling current techniques that practitioners can utilize to reason about ML model reliability and robustness, and 3) examples that show how these concepts and techniques can apply to real-world settings.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。