Most cognitive architectures rely on discrete representation, both in space (e.g., objects) and in time (e.g., events). However, a robot interaction with the world is inherently continuous, both in space and in time. The segmentation of the stream of perceptual inputs a robot receives into discrete and meaningful events poses as a challenge in bridging the gap between internal cognitive representations, and the external world. Event Segmentation Theory, recently proposed in the context of cognitive systems research, sustains that humans segment time into events based on matching perceptual input with predictions. In this work we propose a framework for online event segmentation, targeting robots endowed with active perception. Moreover, sensory processing systems have an intrinsic latency, resulting from many factors such as sampling rate, and computational processing, and which is seldom accounted for. This framework is founded on the theory of dynamical systems synchronization, where the system considered includes both the robot and the world coupled (strong anticipation). An adaption rule is used to perform simultaneous system identification and synchronization, and anticipating synchronization is employed to predict the short-term system evolution. This prediction allows for an appropriate control of the robot actuation. Event boundaries are detected once synchronization is lost (sudden increase of the prediction error). An experimental proof of concept of the proposed framework is presented, together with some preliminary results corroborating the approach.
Achelous++: Power-Oriented Water-Surface Panoptic Perception Framework on Edge Devices based on Vision-Radar Fusion and Pruning of Heterogeneous Modalities
University of Liverpool(利物浦大学);Xi’an Jiaotong-Liverpool University(西交利物浦大学);JITRI(江苏省产业技术研究院);Nantong University(南通大学)
Action Anticipation: Reading the Intentions of Humans and Robots
Institute for Systems and Robotics(系统与机器人研究所);Instituto Superior Técnico(高等技术学院);Universidade de Lisboa(里斯本大学);Faculty of Technical Sciences(技术科学学院);University of Novi Sad(诺维萨德大学);University of Edinburgh(爱丁堡大学);School of Engineering(工程学院);EPFL(洛桑联邦理工学院)
StixelNExT++: Lightweight Monocular Scene Segmentation and Representation for Collective Perception
Institut Pascal ISPR (Image, Systems of Perception, Robotics), Universite Clermont Auvergne INP / CNRS(帕斯卡尔研究所(图像、感知系统、机器人),克莱蒙特大学INP/CNRS);Institute for Intelligent Systems at Esslingen University of Applied Sciences(埃斯林根应用科学大学智能系统研究所)
Temporally Consistent Unsupervised Segmentation for Mobile Robot Perception
Oden Institute for Computational Engineering & Sciences, University of Texas at Austin(德纳学院,德克萨斯大学奥斯汀分校);DEVCOM Army Research Laboratory, Adelphi, MD, United States(陆军研究实验室,阿德菲,马里兰州,美国);Department of Electrical and Computer Engineering, University of Massachusetts Dartmouth(电气与计算机工程系,马萨诸塞大学达特茅斯分校)
More than Segmentation: Benchmarking SAM 3 for Segmentation, 3D Perception, and Reconstruction in Robotic Surgery
The Chinese University of Hong Kong(香港中文大学);The Hong Kong University of Science and Technology(香港科学与技术大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Technical University of Munich(慕尼黑技术大学)
Perception Framework through Real-Time Semantic Segmentation and Scene Recognition on a Wearable System for the Visually Impaired
Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院人形机器人与智能系统研究所);Hangzhou SurImage Technology Company Ltd.(杭州 SurImage 科技有限公司);Hangzhou KrVision Technology Company Ltd.(杭州 KrVision 科技有限公司)
Panoptic Lintention Network: Towards Efficient Navigational Perception for the Visually Impaired
Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院人机与机器人研究所);Sino-German School, Tongji University(同济大学中德学院);Hangzhou SurImage Technology Company Ltd.(杭州 SurImage 科技有限公司);Hangzhou KrVision Technology Company Ltd.(杭州 KrVision 科技有限公司)
StreamMOS: Streaming Moving Object Segmentation with Multi-View Perception and Dual-Span Memory
Faculty of Robot Science and Engineering, Northeastern University(东北大学机器人科学与工程学院);National Frontiers Science Center for Industrial Intelligence and Systems Optimization, Northeastern University(东北大学工业智能与系统优化国家前沿科学中心);Key Laboratory of Data Analytics and Optimization for Smart Industry, Ministry of Education, Northeastern University(东北大学智慧工业数据分析与优化教育部重点实验室)
Hyper-V2X: Hypernetworks for Estimating Epistemic and Aleatoric Uncertainty in Cooperative Bird's-Eye-View Semantic Segmentation
CARISSMA Institute for Electric, COnnected, and Secure Mobility (C-ECOS), Technische Hochschule Ingolstadt(CARISSMA电动、连接与安全移动研究所(C-ECOS)、因戈尔施塔特技术大学);University of Applied Sciences Aschaffenburg(阿施发堡应用科学大学)
Unveiling the Potential of Segment Anything Model 2 for RGB-Thermal Semantic Segmentation with Language Guidance
School of Artificial Intelligence and Robotics, Hunan University(人工智能与机器人学院,湖南大学);National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University(机器人视觉感知与控制技术国家工程研究中心,湖南大学);AI Thrust, Hong Kong University of Science and Technology (Guangzhou)(香港理工大学(广州)人工智能方向)
Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review
University of Liverpool(利物浦大学);Xi’an Jiaotong-Liverpool University(西交利物浦大学);Institute of Deep Perception Technology, JITRI(江苏省产业技术研究院深度感知技术研究所);XJTLU-JITRI Academy of Industrial Technology(西交利物浦大学-江苏省产业技术研究院工业技术学院)
On Domain-Specific Pre-Training for Effective Semantic Perception in Agricultural Robotics
University of Bonn(波恩大学);University of Oxford(牛津大学);Lamarr Institute for Machine Learning and Artificial Intelligence(拉马尔机器学习与人工智能研究所);La Sapienza University of Rome(罗马第一大学)
LiDAR Based Semantic Perception for Forklifts in Outdoor Environments
Faculty of Engineering and Informatics, University of Applied Sciences Aschaffenburg(应用科学阿施芬堡大学工程与信息学院);Linde Material Handling GmbH, Kion Group(林德物料搬运有限公司,Kion集团)