arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.03460cs.CV
收藏

从3D感知到安全推理:基于图的实时地下矿井监控框架

From 3D Perception to Safety Reasoning: A Graph-Based Framework for Real-Time Underground Mine Monitoring

University of New South Wales(新南威尔士大学);University of Southern Queensland(南昆士兰大学)

Pasindu Ranasinghe, Simit Raval, Dibyayan Patra, Bikram Banerjee, Ismet Canbulat

AI总结:

提出一个结合3D语义感知、不确定性异常检测、规则检查、设备端LLM推理和GraphRAG记忆分析的连续监控框架,通过场景图和时序图实现结构化安全推理,在115个危险场景中达到93%的覆盖率和92.7%的感知精度。

摘要:

地下煤矿开采要求人员和重型设备在共享、受限且照明不良的空间中作业,其中设备接近违规、结构不稳定和遮挡盲区等危险难以预测。传统监控系统(包括固定摄像头和基于规则的接近警报)可以检测预定义事件,但缺乏识别复杂或演变危险所需的3D场景理解和上下文记忆。本文提出一个连续监控框架,将彩色3D点云转换为结构化和可追溯的安全推理输出。该框架结合了3D语义感知、基于不确定性的异常检测、基于规则的危险检查、设备端LLM推理和基于GraphRAG的记忆分析,以识别即时危险并解释长期安全模式。场景图和时序图作为显式知识结构,连接推理阶段的感知输出。为克服标记地下数据的稀缺性,结合真实巷道扫描、受控物体放置和高保真长壁模拟生成多样化的危险场景,同时自监督预训练从有限标注中改进分割。感知模型在30 FPS下达到92.7%的准确率,内存使用低。在115个危险场景中,基于规则的检查覆盖率为57%,结合上下文LLM推理提高到76%,使用基于历史记录的记忆推理达到93%。定性结果表明,不确定性衍生的异常信号支持对超出预定义类别的分布外危险进行解释。总体而言,基于图的知识表示结合3D感知和分层安全推理,为地下矿井监控中的智能决策支持提供了实用基础。

英文摘要:

Underground coal mining requires personnel and heavy equipment to operate within shared, confined, and poorly illuminated spaces where hazards such as equipment proximity violations, structural instabilities, and occluded blind spots are difficult to anticipate. Conventional monitoring systems, including fixed cameras and rule-based proximity alerts, can detect predefined events but lack the 3D scene understanding and contextual memory needed to identify complex or evolving hazards. This paper presents a continuous monitoring framework that converts colourised 3D point clouds into structured and traceable safety reasoning outputs. The framework combines 3D semantic perception, uncertainty-based anomaly detection, rule-based hazard checks, on-device LLM reasoning, and GraphRAG -based memory analysis to identify immediate hazards and interpret longer-term safety patterns. Scene and temporal graphs serve as the explicit knowledge structure, linking perception outputs across reasoning stages. To overcome the scarcity of labeled underground data, real roadway scans, controlled object placement, and high-fidelity longwall simulation were combined to generate diverse hazard scenarios, while self-supervised pretraining improved segmentation from limited annotations. The perception model achieved 92.7% accuracy at 30 FPS with low memory usage. Across 115 hazard scenarios, rule-based checks achieved 57% coverage, increasing to 76% with contextual LLM reasoning and 93% with memory-based reasoning using historical records. Qualitative results show uncertainty-derived anomaly signals support the interpretation of out-of-distribution hazards beyond predefined classes. Overall, graph-based knowledge representation combined with 3D perception and layered safety reasoning provides a practical foundation for intelligent decision support in underground mine monitoring.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑