Runtime monitoring provides a more realistic and applicable alternative to verification in the setting of real neural networks used in industry. It is particularly useful for detecting out-of-distribution (OOD) inputs, for which the network was not trained and can yield erroneous results. We extend a runtime-monitoring approach previously proposed for classification networks to perception systems capable of identification and localization of multiple objects. Furthermore, we analyze its adequacy experimentally on different kinds of OOD settings, documenting the overall efficacy of our approach.
Unifying Runtime Monitoring Approaches for Safety-Critical Machine Learning: Application to Vision-Based Landing
LAAS-CNRS(法国图卢兹Laas--cnrs研究所);University of Toulouse(图卢兹大学);Thales(泰勒斯);ONERA(法国国家航空器研究与测试中心);Espace-Dev, IRD, Université de Montpellier(Espace-Dev, 法国国家农业与食品研发机构, 图卢兹大学);Universidade Federal do Rio Grande do Norte(巴西北里奥格兰德联邦大学)
Gaussian-Based and Outside-the-Box Runtime Monitoring Join Forces
Audi AG(奥迪股份公司);Masaryk University(马萨里克大学);Technical University of Munich(慕尼黑工业大学);AImotion Bavaria, Technische Hochschule Ingolstadt(因戈尔施塔特应用科学大学巴伐利亚人工智能中心)
Runtime Monitoring of Perception-Based Autonomous Systems via Embedding Temporal Logic
Software and Societal Systems Department(软件与社会系统部门);Carnegie Mellon University(卡内基梅隆大学);General Robotics(通用机器人);Aeronautics and Astronautics Department(航空与航天系);University of Washington(华盛顿大学)
Explaining Unreliable Perception in Automated Driving: A Fuzzy-based Monitoring Approach
Engineering Resilient Cognitive Systems Technical University of Munich(技术大学慕尼黑);Automation Systems Fraunhofer Institute for Cognitive Systems IKS Munich, Germany(慕尼黑弗劳恩霍夫认知系统研究所)
OGAM: Connecting Systematic Testing to Runtime Assurance through Object-Grounded Attention Monitoring for VLA Policies
Carl von Ossietzky University of Oldenburg(卡尔·冯·奥西茨基大学奥尔登堡分校);Huadian Electric Power Research Institute(华电电力科学研究院);Chalmers University of Technology(查尔姆斯理工大学)
Runtime Monitoring and Enforcement of Conditional Fairness in Generative AIs
Chalmers University of Technology, Sweden Carl von Ossietzky Universität Oldenburg, Germany Universit\'e Grenoble Alpes, France University of Warwick, United Kingdom CSX-AI, France SRI International, United States