Robots are expected to operate autonomously in dynamic environments. Understanding the underlying dynamic characteristics of objects is a key enabler for achieving this goal. In this paper, we propose a method for pointwise semantic classification of 3D LiDAR data into three classes: non-movable, movable and dynamic. We concentrate on understanding these specific semantics because they characterize important information required for an autonomous system. Non-movable points in the scene belong to unchanging segments of the environment, whereas the remaining classes corresponds to the changing parts of the scene. The difference between the movable and dynamic class is their motion state. The dynamic points can be perceived as moving, whereas movable objects can move, but are perceived as static. To learn the distinction between movable and non-movable points in the environment, we introduce an approach based on deep neural network and for detecting the dynamic points, we estimate pointwise motion. We propose a Bayes filter framework for combining the learned semantic cues with the motion cues to infer the required semantic classification. In extensive experiments, we compare our approach with other methods on a standard benchmark dataset and report competitive results in comparison to the existing state-of-the-art. Furthermore, we show an improvement in the classification of points by combining the semantic cues retrieved from the neural network with the motion cues.
SN-LiDAR: Semantic Neural Fields for Novel Space-time View LiDAR Synthesis
Shanghai Jiao Tong University(上海交通大学);Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属瑞金医院);Renji Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属仁济医院)
Feasibility of Indoor Frame-Wise Lidar Semantic Segmentation via Distillation from Visual Foundation Model
1 Department of Earth Observation Science, Faculty of Geo-Information Science;Earth Observation (ITC), University of Twente, 7522 NB Enschede, The Netherlands
Semantic2D: Enabling Semantic Scene Understanding with 2D Lidar Alone
School of Computing and Data Science, The University of Hong Kong(计算与数据科学学院,香港大学);Department of Mechanical Engineering, Temple University(机械工程系, Temple大学)
TeFF: Tracking-enhanced Forgetting-free Few-shot 3D LiDAR Semantic Segmentation
Research Center for Intelligent Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所智能计算系统研究中心);School of Computer Science and Technology, University of Chinese Academy of Sciences(中国科学院大学计算机科学与技术学院);China North Artificial Intelligence & Innovation Research Institute(中国北方人工智能与创新研究院);Collective Intelligence & Collaboration Laboratory (CIC)(集体智能与协作实验室);Research Center for In(研究中心)
Multimodal Signal Processing For Thermo-Visible-Lidar Fusion In Real-time 3D Semantic Mapping
College of Mechatronics and Control Engineering, Shenzhen University(深圳大学机械与控制工程学院);School of Robotics, Xi’an-Jiaotong Liverpool University(西安交通大学利物浦大学机器人学院)
Meta-RangeSeg: LiDAR Sequence Semantic Segmentation Using Multiple Feature Aggregation
Zhejiang University(浙江大学);Alibaba-Zhejiang University Joint Research Institute of Frontier Technologies(阿里巴巴-浙江大学前沿技术联合研究院);Hikvision Research Institute(海康威视研究院)
Boosting LiDAR-Based Localization with Semantic Insight: Camera Projection versus Direct LiDAR Segmentation
Department of Technical Cognitive Systems, FZI Research Center for Information Technology(技术认知系统部门,信息技术研究所以暨创新中心);Karlsruhe Institute of Technology (KIT)(卡尔斯鲁厄大学)
DiffSSC: Semantic LiDAR Scan Completion using Denoising Diffusion Probabilistic Models
Autonomous Intelligent Systems group, Computer Science Institute VI – Intelligent Systems and Robotics – and the Center for Robotics and the Lamarr Institute for Machine Learning and Artificial Intelligence, University of Bonn, Germany(自主智能系统组,计算机科学研究所VI——智能系统与机器人——和机器人中心以及拉马尔人工智能与机器学习研究所,波恩大学,德国)
Lidar-based Object Classification with Explicit Occlusion Modeling
College of Intelligence Science and Technology, National University of Defense Technology(国防科技大学智能科学与技术学院);Unmanned Systems Research Center, National Innovation Institute of Defense Technology(国防科技创新研究院无人系统研究中心)
LiDAR Based Semantic Perception for Forklifts in Outdoor Environments
Faculty of Engineering and Informatics, University of Applied Sciences Aschaffenburg(应用科学阿施芬堡大学工程与信息学院);Linde Material Handling GmbH, Kion Group(林德物料搬运有限公司,Kion集团)
Exploring Single Domain Generalization of LiDAR-based Semantic Segmentation under Imperfect Labels
Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology(自动化与机器人研究所,卡尔斯鲁厄技术大学);Department of Civil, Environmental and Geomatic Engineering, University College London(土木、环境与地理工程系,伦敦大学学院)
Real Time Semantic Segmentation of High Resolution Automotive LiDAR Scans
Faculty of Engineering, University of Applied Sciences Aschaffenburg(应用科学阿施芬堡大学工程学院);Intelligent Embedded Systems Lab, University of Kassel(卡塞尔大学智能嵌入式系统实验室)
Semantic localization on BIM-generated maps using a 3D LiDAR sensor
Hong Kong University of Science and Technology(香港科技大学);National University of Singapore(新加坡国立大学);China Mobile (Zhejiang) Innovation Research Institute Co., Ltd(中国移动(浙江)创新研究院有限公司)
SLCF-Net: Sequential LiDAR-Camera Fusion for Semantic Scene Completion using a 3D Recurrent U-Net
University of Bonn(波恩大学);Lamarr Institute for Machine Learning and Artificial Intelligence(拉马尔机器学习与人工智能研究所);Center for Robotics(机器人中心);Computer Science Institute VI – Intelligent Systems and Robotics(计算机科学研究所VI——智能系统与机器人)