An effective understanding of the environment and accurate trajectory prediction of surrounding dynamic obstacles are indispensable for intelligent mobile systems (e.g. autonomous vehicles and social robots) to achieve safe and high-quality planning when they navigate in highly interactive and crowded scenarios. Due to the existence of frequent interactions and uncertainty in the scene evolution, it is desired for the prediction system to enable relational reasoning on different entities and provide a distribution of future trajectories for each agent. In this paper, we propose a generic generative neural system (called STG-DAT) for multi-agent trajectory prediction involving heterogeneous agents. The system takes a step forward to explicit interaction modeling by incorporating relational inductive biases with a dynamic graph representation and leverages both trajectory and scene context information. We also employ an efficient kinematic constraint layer applied to vehicle trajectory prediction. The constraint not only ensures physical feasibility but also enhances model performance. Moreover, the proposed prediction model can be easily adopted by multi-target tracking frameworks. The tracking accuracy proves to be improved by empirical results. The proposed system is evaluated on three public benchmark datasets for trajectory prediction, where the agents cover pedestrians, cyclists and on-road vehicles. The experimental results demonstrate that our model achieves better performance than various baseline approaches in terms of prediction and tracking accuracy.
A Data-driven Approach for Human Pose Tracking Based on Spatio-temporal Pictorial Structure
Indian Statistical Institute(印度统计学院)
在本文中,我们提出了一个数据驱动的方法,在视频数据中的人体姿态跟踪。我们制定的人体姿态跟踪问题作为一个离散的优化问题的基础上的时空图像结构模型和解决这个问题的贪婪框架非常有效。我们提出的模型来跟踪人体的姿势相结合的人从单一的图像和传统的目标跟踪视频中的姿态估计。我们的姿态跟踪目标函数由以下条款组成:一个帧内的一部分的外观,从前一帧到当前帧的时间位移的一部分,和一个部分的空间依赖性与它的父亲在图形结构中的相似性。在基准数据集(VideoPose2,Poses in the Wild and Outdoor Pose)以及我们新构建的ICDPose数据集上的实验评估表明了我们所提出的方法的实用性。
Learning Spatio-Appearance Memory Network for High-Performance Visual Tracking
Southeast University(东南大学);Nanjing University of Information Science and Technology(南京信息工程大学);JD Finance America Corporation(京东金融美国公司);Tianjin University of Technology(天津理工大学);Harbin Institute of Technology(哈尔滨工业大学);Peng Cheng Lab(鹏城实验室)
DMTrack: Spatio-Temporal Multimodal Tracking via Dual-Adapter
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences(中国科学院大学杭州高等研究院);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);Department of Computer Science and Engineering, University of North Texas(北卡罗来纳州立大学计算机科学与工程系);OPPO AI Center(OPPO人工智能中心)
UBATrack: Spatio-Temporal State Space Model for General Multi-Modal Tracking
Key Laboratory of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University(教育区块链与智能技术重点实验室,教育部,广西师范大学);Guangxi Key Laboratory of Multi-Source Information Mining and Security, Guangxi Normal University(广西多源信息挖掘与安全重点实验室,广西师范大学);University Engineering Research Center of Educational Intelligent Technology, Guangxi Normal University(教育智能技术大学工程研究中心,广西师范大学);Guangxi Key Laboratory of Machine Vision and Intelligent Control, Wuzhou University(广西机器视觉与智能控制重点实验室,梧州大学)
DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs
Xiamen University(厦门大学);Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);China University of Mining and Technology(中国矿业大学);Shenzhen Technology University(深圳技术大学)
Unsupervised 4D Cardiac Motion Tracking with Spatiotemporal Optical Flow Networks
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);DJI Technology Co., Ltd.(大疆创新科技有限公司);Shenzhen University of Advanced Technology(深圳理工大学)
S.T.A.R.-Track: Latent Motion Models for End-to-End 3D Object Tracking with Adaptive Spatio-Temporal Appearance Representations
Mercedes-Benz AG(梅赛德斯-奔驰公司);University of Tübingen(蒂宾根大学);Institute for Intelligent Systems, Esslingen University of Applied Sciences(埃斯林根应用科学大学智能系统研究所)
Enhancing Multi-Camera People Tracking with Anchor-Guided Clustering and Spatio-Temporal Consistency ID Re-Assignment
University of Washington(华盛顿大学);Electronics and Telecommunications Research Institute(电子与电信研究所);National Center for High-Performance Computing(国家高性能计算中心)
提出一种结合锚定引导聚类与时空一致性的多摄像机多人员跟踪方法,在CVPR AI City Challenge 2023上以95.36% IDF1获第一名。
Representation Alignment Contrastive Regularization for Multi-Object Tracking
College of Computer Science and Technology, Zhejiang Gongshang University(浙江工商大学计算机科学与技术学院);Zhejiang Key Laboratory of Big Data and Future E-Commerce Technology(浙江省大数据与未来电子商务技术重点实验室);Zhejiang Uniview Technologies Co.,Ltd.(浙江宇视科技有限公司)
ST-MTL: Spatio-Temporal Multitask Learning Model to Predict Scanpath While Tracking Instruments in Robotic Surgery
NUS Graduate School for Integrative Sciences and Engineering (NGS), National University of Singapore(新加坡国立大学综合科学与工程研究生院);Dept. of Biomedical Engineering, National University of Singapore(新加坡国立大学生物医学工程系);Dept. of Instrumentation and Control Engineering, NIT Trichy(印度国立理工学院蒂鲁奇拉帕利分校仪器与控制工程系);Dept. of Otolaryngology, Singapore General Hospital(新加坡中央医院耳鼻喉科)
Spatio-Temporal Bi-directional Cross-frame Memory for Distractor Filtering Point Cloud Single Object Tracking
School of Electronic and Information Engineering, Changchun University of Science and Technology(长春理工大学电子信息工程学院);Hong Kong Applied Science and Technology Research Institute(香港应用科技研究院)
STCMOT: Spatio-Temporal Cohesion Learning for UAV-Based Multiple Object Tracking
University of Chinese Academy of Sciences(中国科学院大学);Institute of Optics and Electronics(光电技术研究所);Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔朗根-纽伦堡弗里德里希-亚历山大大学)
SpaER: Learning Spatio-temporal Equivariant Representations for Fetal Brain Motion Tracking
Boston Children’s Hospital(波士顿儿童医院);Harvard Medical School(哈佛医学院);Northeastern University(东北大学);Massachusetts Institute of Technology(麻省理工学院);University of California Irvine(加州大学欧文分校)
HAD: Hierarchical Asymmetric Distillation to Bridge Spatio-Temporal Gaps in Event-Based Object Tracking
Sanya Science and Education Innovation Park, Wuhan University of Technology(武汉理工大学三亚科学教育创新园);Hubei Key Laboratory of Transportation Internet of Things, School of Computer Science and Artificial Intelligence, Wuhan University of Technology(湖北省交通运输物联网重点实验室,计算机科学与人工智能学院,武汉理工大学);State Key Laboratory for Multimedia Information Processing, Peking University(多媒体信息处理国家重点实验室,北京大学)
Spatio-temporal Graph Learning on Adaptive Mined Key Frames for High-performance Multi-Object Tracking
School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院);Anhui Provincial Key Laboratory of Multimodal Cognitive Computation(安徽省多模态认知计算重点实验室)
Dynamic Subframe Splitting and Spatio-Temporal Motion Entangled Sparse Attention for RGB-E Tracking
School of Artificial Intelligence and Computer Science, Jiangnan University(江南大学人工智能与计算机学院);Centre for Vision, Speech and Signal Processing, University of Surrey(萨里大学视觉、语音与信号处理中心)