基于搜索的笔记本电脑翻新机器人软件鲁棒性测试
Search-based Robustness Testing of Laptop Refurbishing Robotic Software
AI总结:
本文提出PROBE方法,利用多目标优化寻找最小局部扰动以暴露笔记本翻新机器人软件中物体检测模型的缺陷,验证其在生成失效诱导扰动方面的有效性。
摘要:
丹麦技术研究所致力于将先进技术(包括机器人)转移到工业和公共部门。一个关键应用是使用专用机器人进行笔记本电脑翻新,旨在促进再利用、减少电子垃圾并支持欧洲循环经济行动计划。此类机器人软件通常包含使用物体检测模型检测物体的功能,例如识别螺丝用于笔记本拆卸或检测贴纸以去除。确保此类模型对小输入变化的鲁棒性仍然是关键挑战,解决此问题对于避免翻新过程中可能对笔记本电脑造成损害至关重要。本文提出PROBE,一种基于搜索的鲁棒性测试方法,利用多目标优化来识别最小、局部化的扰动,以暴露笔记本翻新机器人软件中物体检测模型的缺陷。PROBE采用NSGA-II系统探索扰动空间,优化失败诱导,考虑定位和置信度以及扰动幅度,同时能够发现多样化的失败案例。结果表明,PROBE在生成失败诱导扰动方面比随机搜索有效3至7倍,同时需要较小的扰动幅度,并且生成的扰动可以跨模型转移。我们进一步表明,元关系提供额外的见解,使在非失败情况下也能评估模型的稳定性。
英文摘要:
The Danish Technological Institute (DTI) focuses on transferring advanced technologies (including robots) to the industry and the public sector. One key application is laptop refurbishment using specialized robots, aimed at promoting reuse, reducing electronic waste, and supporting the European Circular Economy Action Plan. The software of such robots often includes features that use object detection models to detect objects for various purposes, such as identifying screws for laptop disassembly or detecting stickers to remove them. Ensuring the robustness of such models to small input variations remains a critical challenge, and addressing it is important to avoid potential damage to laptops during refurbishment. In this paper, we propose PROBE, a search-based robustness testing approach that leverages multi-objective optimization to identify minimal, localized perturbations that expose failures in object detection models used in the software of laptop refurbishing robots. PROBE employs NSGA-II to systematically explore the perturbation space, optimizing for failure induction considering both localization and confidence, and perturbation magnitude, while enabling the discovery of diverse failure cases. Results show that PROBE is 3$\times$ to 7$\times$ more effective than random search in generating failure-inducing perturbations, while requiring smaller perturbation magnitudes, and that the generated perturbations transfer across models. We further show that metamorphic relations provide additional insights into model robustness, enabling the assessment of stability even in non-failing cases.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。