DiffMOT:一种基于扩散的非线性预测实时多目标跟踪器
DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Prediction
AI总结:
针对多目标跟踪中复杂的非线性运动问题,提出基于扩散模型的实时跟踪器DiffMOT,其核心是解耦扩散运动预测器(D²MP),通过建模运动分布并依据历史信息预测个体运动,在DanceTrack和SportsMOT数据集上取得SOTA性能。
摘要:
在多目标跟踪中,目标常表现出加速、减速的非线性运动及不规则方向变化。采用卡尔曼滤波运动预测的基于检测的跟踪(TBD)在行人主导场景中表现良好,但在多目标同时执行非线性且多样化运动的复杂情况下则表现不足。为应对复杂的非线性运动,我们提出了一种基于扩散的实时MOT方法,名为DiffMOT。具体而言,针对运动预测器组件,我们提出了一种新颖的解耦扩散运动预测器(D²MP)。它将数据呈现的各种运动的整体分布作为一个整体进行建模。它还根据个体的历史运动信息预测单个目标的运动。此外,它以少得多的采样步数优化扩散过程。作为MOT跟踪器,DiffMOT实时速度达22.7FPS,并在DanceTrack和SportsMOT数据集上以HOTA指标分别取得62.3%和76.2%的成绩,优于现有最先进方法。据我们所知,DiffMOT是首个将扩散概率模型引入MOT以解决非线性运动预测的工作。
英文摘要:
In Multiple Object Tracking, objects often exhibit non-linear motion of acceleration and deceleration, with irregular direction changes. Tacking-by-detection (TBD) trackers with Kalman Filter motion prediction work well in pedestrian-dominant scenarios but fall short in complex situations when multiple objects perform non-linear and diverse motion simultaneously. To tackle the complex non-linear motion, we propose a real-time diffusion-based MOT approach named DiffMOT. Specifically, for the motion predictor component, we propose a novel Decoupled Diffusion-based Motion Predictor (D$^2$MP). It models the entire distribution of various motion presented by the data as a whole. It also predicts an individual object's motion conditioning on an individual's historical motion information. Furthermore, it optimizes the diffusion process with much fewer sampling steps. As a MOT tracker, the DiffMOT is real-time at 22.7FPS, and also outperforms the state-of-the-art on DanceTrack and SportsMOT datasets with $62.3\%$ and $76.2\%$ in HOTA metrics, respectively. To the best of our knowledge, DiffMOT is the first to introduce a diffusion probabilistic model into the MOT to tackle non-linear motion prediction.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。