Florian Tambon, Gabriel Laberge, Le An, Amin Nikanjam, Paulina Stevia Nouwou Mindom, Yann Pequignot, Foutse Khomh, Giulio Antoniol, Ettore Merlo, François Laviolette
备注:
60 pages (92 pages with references and complements), submitted to a journal (Automated Software Engineering). Changes: Emphasizing difference traditional software engineering / ML approach. Adding Related Works, Threats to Validity and Complementary Materials. Adding a table listing papers reference for each section/subsections
Context: Machine Learning (ML) has been at the heart of many innovations over the past years. However, including it in so-called 'safety-critical' systems such as automotive or aeronautic has proven to be very challenging, since the shift in paradigm that ML brings completely changes traditional certification approaches.
Objective: This paper aims to elucidate challenges related to the certification of ML-based safety-critical systems, as well as the solutions that are proposed in the literature to tackle them, answering the question 'How to Certify Machine Learning Based Safety-critical Systems?'.
Method: We conduct a Systematic Literature Review (SLR) of research papers published between 2015 to 2020, covering topics related to the certification of ML systems. In total, we identified 217 papers covering topics considered to be the main pillars of ML certification: Robustness, Uncertainty, Explainability, Verification, Safe Reinforcement Learning, and Direct Certification. We analyzed the main trends and problems of each sub-field and provided summaries of the papers extracted.
Results: The SLR results highlighted the enthusiasm of the community for this subject, as well as the lack of diversity in terms of datasets and type of models. It also emphasized the need to further develop connections between academia and industries to deepen the domain study. Finally, it also illustrated the necessity to build connections between the above mention main pillars that are for now mainly studied separately.
Conclusion: We highlighted current efforts deployed to enable the certification of ML based software systems, and discuss some future research directions.
Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learning
Institute for Aerospace Studies, University of Toronto(多伦多大学航空航天研究所);University of Toronto Robotics Institute(多伦多大学机器人研究所);Vector Institute for Artificial Intelligence(向量人工智能研究院)
CISPA Helmholtz Center for Information Security(CISPA亥姆霍兹信息安全中心);ETH Zurich(苏黎世联邦理工学院);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);VMware Research(VMware研究院)
LLM Safety Alignment in Low-Resource Languages: A Systematic Literature Review
African Institute for Mathematical Sciences (AIMS)(非洲数学科学研究所);Bayero University Kano(卡诺贝罗大学);Brown University(布朗大学);Centrum Wiskunde & Informatica(数学与计算机科学中心);University of Pretoria(比勒陀利亚大学);University of Hamburg(汉堡大学);Imperial College London(伦敦帝国学院)
Using large language models for embodied planning introduces systematic safety risks
ETH Zurich(苏黎世联邦理工学院);University College London(伦敦大学学院);Stanford University(斯坦福大学);Northwestern University(西北大学);National University of Singapore(新加坡国立大学)