arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2107.02868cs.LGstat.ML
收藏

评价AI/ML模型性能和鲁棒性的原则

Principles for Evaluation of AI/ML Model Performance and Robustness

Olivia Brown, Andrew Curtis, Justin Goodwin

摘要:

美国国防部(DoD)已大幅增加了对人工智能和机器学习(AI/ML)能力的设计、评估和部署的投资,以满足国家安全需求。虽然AI/ML在学术和商业领域取得了许多成功,但其中许多系统也被证明是脆弱和不健壮的。在一个复杂且不断变化的国家安全环境中,国防部必须建立一个合理而有条理的流程,在这些新功能部署到现场之前评估AI/ML模型的性能和鲁棒性。本文回顾了AI/ML开发过程,强调了AI/ML模型评估的常见最佳实践,并向国防部评估人员提出了建议,以确保部署强大的AI/ML能力以满足国家安全需求。

英文摘要:

The Department of Defense (DoD) has significantly increased its investment in the design, evaluation, and deployment of Artificial Intelligence and Machine Learning (AI/ML) capabilities to address national security needs. While there are numerous AI/ML successes in the academic and commercial sectors, many of these systems have also been shown to be brittle and nonrobust. In a complex and ever-changing national security environment, it is vital that the DoD establish a sound and methodical process to evaluate the performance and robustness of AI/ML models before these new capabilities are deployed to the field. This paper reviews the AI/ML development process, highlights common best practices for AI/ML model evaluation, and makes recommendations to DoD evaluators to ensure the deployment of robust AI/ML capabilities for national security needs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑