基于深度学习的视觉-超声机器人系统用于制造业气体与电弧危害检测
Vision-Ultrasound Robotic System based on Deep Learning for Gas and Arc Hazard Detection in Manufacturing
AI总结:
针对制造业气体泄漏与电弧放电的检测需求,本研究提出一种基于深度学习的视觉-超声机器人系统,融合多模态数据实现自主检测分类,准确率达99%,噪声环境下性能较传统模型提升44%p,推理时间2.1秒,可实时部署。
摘要:
工业环境中的气体泄漏和电弧放电存在重大风险,需要稳健的检测系统以确保安全和运营效率。受人类将视觉识别与声学验证相结合的协议启发,本研究提出一种基于深度学习的机器人系统,用于在制造环境中自主检测和分类气体泄漏与电弧放电。该系统设计为完全在机器人上执行所有实验任务。利用112通道、采样率96 kHz的声学相机捕捉超声频率,系统处理在不同工业场景下记录的真实世界数据集,这些数据集包含多种气体泄漏配置(如针孔、开口端)和不同环境噪声条件下的局部放电类型(电晕、表面、悬浮)。所提出的系统集成了视觉检测和波束形成增强的声学分析 pipeline:信号通过STFT变换并经Gamma校正优化,实现稳健特征提取;受Inception启发的CNN进一步对危害进行分类,气体泄漏检测准确率达99%。系统不仅检测单个危害源,还通过融合视觉与声学传感器的多模态数据提升分类可靠性。在混响和噪声增强环境中测试时,系统性能较传统模型高出44个百分点,实验任务经过精心设计以确保公平性和可重复性。此外,系统针对实时部署进行了优化,在移动机器人平台上的推理时间保持在2.1秒。通过模拟类人巡检协议并集成视觉与声学模态,本研究为工业自动化提供了有效解决方案,显著提升了安全性和运营可靠性。
英文摘要:
Gas leaks and arc discharges present significant risks in industrial environments, requiring robust detection systems to ensure safety and operational efficiency. Inspired by human protocols that combine visual identification with acoustic verification, this study proposes a deep learning-based robotic system for autonomously detecting and classifying gas leaks and arc discharges in manufacturing settings. The system is designed to execute all experimental tasks entirely onboard the robot. Utilizing a 112-channel acoustic camera operating at a 96 kHz sampling rate to capture ultrasonic frequencies, the system processes real-world datasets recorded in diverse industrial scenarios. These datasets include multiple gas leak configurations (e.g., pinhole, open end) and partial discharge types (Corona, Surface, Floating) under varying environmental noise conditions. Proposed system integrates visual detection and a beamforming-enhanced acoustic analysis pipeline. Signals are transformed using STFT and refined through Gamma Correction, enabling robust feature extraction. An Inception-inspired CNN further classifies hazards, achieving 99% gas leak detection accuracy. The system not only detects individual hazard sources but also enhances classification reliability by fusing multi-modal data from both vision and acoustic sensors. When tested in reverberation and noise-augmented environments, the system outperformed conventional models by up to 44%p, with experimental tasks meticulously designed to ensure fairness and reproducibility. Additionally, the system is optimized for real-time deployment, maintaining an inference time of 2.1 seconds on a mobile robotic platform. By emulating human-like inspection protocols and integrating vision with acoustic modalities, this study presents an effective solution for industrial automation, significantly improving safety and operational reliability.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。