We introduce a perception-related function, OWL, designed to address the complex challenges of 3D perception during motion. It derives its values directly from two fundamental visual motion cues, with one set of cue values per point per time instant. During motion, two visual motion cues relative to a fixation point emerge: 1) perceived local visual looming of points near the fixation point, and 2) perceived rotation of the rigid object relative to the fixation point. It also expresses the relation between two well-known physical quantities, the relative instantaneous directional range and directional translation in 3D between the camera and any visible 3D point, without explicitly requiring their measurement or prior knowledge of their individual values. OWL offers a unified, analytical time-based approach that enhances and simplifies key perception capabilities, including scaled 3D mapping and camera heading. Simulations demonstrate that OWL achieves geometric constancy of 3D objects over time and enables scaled 3D scene reconstruction from visual motion cues alone. By leveraging direct measurements from raw visual motion image sequences, OWL values can be obtained without prior knowledge of stationary environments, moving objects, or camera motion. This approach employs minimalistic, pixel-based, parallel computations, providing an alternative real-time representation for 3D points in relative motion. OWL bridges the gap between theoretical concepts and practical applications in robotics and autonomous navigation and may unlock new possibilities for real-time decision-making and interaction, potentially serving as a building block for next-generation autonomous systems. This paper offers an alternative perspective on machine perception, with implications that may extend to natural perception and contribute to a better understanding of behavioral psychology and neural functionality.
VMBench: A Benchmark for Perception-Aligned Video Motion Generation
AMAP, Alibaba Group(阿里巴巴集团AMAP);CRISE, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所CRISE);School of Computer Science and Technology, University of Chinese Academy of Sciences(中国科学院大学计算机科学与技术学院)
Visual hallucination detection in large vision-language models via evidential conflict
Beijing Key Lab of Traffic Data Mining(北京交通数据挖掘与具身智能重点实验室);State Key Laboratory of Advanced Rail Autonomous Operation(先进轨道交通自主运行国家重点实验室);School of Computer Science and Technology(计算机科学与技术学院);Beijing Jiaotong University(北京交通大学);School of Automation and Intelligence(自动化与智能学院);School of Electronic and Information Engineering(电子与信息工程学院)
Towards Computational Models and Applications of Insect Visual Systems for Motion Perception: A Review
School of Mechanical and Electrical Engineering, Guangzhou University(广州大学机电工程学院);Machine Life and Intelligence Research Centre, Guangzhou University(广州大学机器生命与智能研究中心);Computational Intelligence Lab, School of Computer Science, University of Lincoln(林肯大学计算机科学学院计算智能实验室);Lincoln Centre for Autonomous Systems, University of Lincoln(林肯大学林肯自治系统中心)
Flow Snapshot Neurons in Action: Deep Neural Networks Generalize to Biological Motion Perception
College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局);Show Lab, National University of Singapore(新加坡国立大学Show实验室)
OnlineBEV: Recurrent Temporal Fusion in Bird's Eye View Representations for Multi-Camera 3D Perception
Autonomous Driving Development Center, Hyundai Motors(韩世汽车自动驾驶开发中心);Department of Electrical Engineering, Hanyang University(翰阳大学电气工程系);Interdisciplinary Program in Artificial Intelligence, Seoul National University(首尔国立大学人工智能跨学科项目);Department of Electrical and Computer Engineering, Seoul National University(首尔国立大学电气与计算机工程系)
Biologically Inspired Dynamic Textures for Probing Motion Perception
CNRS(法国国家科学研究中心);UNIC(神经信息与复杂性实验室);Ceremade(Ceremade研究中心);Univ. Paris-Dauphine(巴黎第九大学);Institut de Neurosciences de la Timone(蒂莫内神经科学研究所);UMR 7289 CNRS/Aix-Marseille Université(法国国家科学研究中心/艾克斯-马赛大学 UMR 7289 联合研究单位)
Perception and Navigation in Autonomous Systems in the Era of Learning: A Survey
East China University of Science and Technology(华东理工大学);Western Sydney University(西悉尼大学);Potsdam Institute for Climate Impact Research(波茨坦气候影响研究所);Humboldt University of Berlin(柏林洪堡大学)
Geometric-Topological Perception and Motion Prior for Real-Time Satellite Video Object Tracking
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院航天信息研究所);Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Chinese Academy of Sciences(中国科学院地理空间信息处理与应用系统技术重点实验室);School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子、电气与通信工程学院)
Motion Inspired Unsupervised Perception and Prediction in Autonomous Driving
Waymo LLC(Waymo有限责任公司)
现代自动驾驶系统中基于学习的感知和预测模块通常依赖于昂贵的人工注释,并且被设计为仅感知少数预定义的对象类别。这种闭集范式不足以满足安全关键的自动驾驶任务,其中自动驾驶车辆需要在高度动态的世界中处理任意多种类型的交通参与者及其运动行为。为了解决这个困难,本文开创了一个新颖而具有挑战性的方向,即,训练感知和预测模型,以理解开放集移动对象,无需人工监督。我们提出的框架使用自学习流来触发自动Meta标记管道,以实现自动监督。Waymo Open Dataset上的3D检测实验表明,我们的方法明显优于经典的无监督方法,甚至与有监督场景流的方法相比具有竞争力。我们进一步表明,我们的方法在开集3D检测和轨迹预测方面产生了非常有希望的结果,证实了它在缩小完全监督系统的安全差距方面的潜力。
EgoSIS: From Factorized Visual Ego-Transitions to Motion-Canonical Spatial Evidence for UAV Reasoning
Beihang University(北京航空航天大学);Zhongguancun Academy(中关村学院);Northeastern University(东北大学);Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences(中国科学院空间应用工程与技术中心)
Technical University of Munich(慕尼黑工业大学);Institute for Automotive Engineering, Munich Institute of Robotics and Machine Intelligence, School of Engineering and Design(汽车工程研究所,慕尼黑机器人与机器智能研究所,工程与设计学院)
PP-Motion: Physical-Perceptual Fidelity Evaluation for Human Motion Generation
Tsinghua University(清华大学);University at Buffalo(布法罗大学);BNRist, Tsinghua University(清华大学BNRist研究所);Key Laboratory of Pervasive Computing, Ministry of Education(教育部 pervasive 计算重点实验室);Eastern Institute of Technology, Ningbo(宁波东部技术研究所);University of Rochester(罗切斯特大学)
PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation
School of Electronic Science and Engineering, Nanjing University(南京大学电子科学与工程学院);Key Laboratory of Optoelectronic Devices and Systems with Extreme Performances of MOE, Nanjing University(南京大学极端性能光电技术与系统教育部重点实验室);BNRist, Tsinghua University(清华大学北京信息科学与技术国家研究中心)
Stimulus Motion Perception Studies Imply Specific Neural Computations in Human Visual Stabilization
Montana State University, Dept of Electrical and Computer Engineering(蒙塔那州立大学电气与计算机工程系);University of California, Berkeley, Herbert Wertheim School of Optometry and Vision Science(加州大学伯克利分校赫伯特·韦特海姆视觉科学与眼科学学院)