arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.02075cs.CV
收藏

DiffMOT:一种基于扩散的非线性预测实时多目标跟踪器

DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Prediction

PAII Inc.(PAII公司);Shanghai University(上海大学);National University of Defense Technology(国防科技大学)

Weiyi Lv, Yuhang Huang, Ning Zhang, Ruei-Sung Lin, Mei Han, Dan Zeng

AI总结:

针对多目标跟踪中复杂的非线性运动问题,提出基于扩散模型的实时跟踪器DiffMOT,其核心是解耦扩散运动预测器(D²MP),通过建模运动分布并依据历史信息预测个体运动,在DanceTrack和SportsMOT数据集上取得SOTA性能。

摘要:

在多目标跟踪中,目标常表现出加速、减速的非线性运动及不规则方向变化。采用卡尔曼滤波运动预测的基于检测的跟踪(TBD)在行人主导场景中表现良好,但在多目标同时执行非线性且多样化运动的复杂情况下则表现不足。为应对复杂的非线性运动,我们提出了一种基于扩散的实时MOT方法,名为DiffMOT。具体而言,针对运动预测器组件,我们提出了一种新颖的解耦扩散运动预测器(D²MP)。它将数据呈现的各种运动的整体分布作为一个整体进行建模。它还根据个体的历史运动信息预测单个目标的运动。此外,它以少得多的采样步数优化扩散过程。作为MOT跟踪器,DiffMOT实时速度达22.7FPS,并在DanceTrack和SportsMOT数据集上以HOTA指标分别取得62.3%和76.2%的成绩,优于现有最先进方法。据我们所知,DiffMOT是首个将扩散概率模型引入MOT以解决非线性运动预测的工作。

英文摘要:

In Multiple Object Tracking, objects often exhibit non-linear motion of acceleration and deceleration, with irregular direction changes. Tacking-by-detection (TBD) trackers with Kalman Filter motion prediction work well in pedestrian-dominant scenarios but fall short in complex situations when multiple objects perform non-linear and diverse motion simultaneously. To tackle the complex non-linear motion, we propose a real-time diffusion-based MOT approach named DiffMOT. Specifically, for the motion predictor component, we propose a novel Decoupled Diffusion-based Motion Predictor (D$^2$MP). It models the entire distribution of various motion presented by the data as a whole. It also predicts an individual object's motion conditioning on an individual's historical motion information. Furthermore, it optimizes the diffusion process with much fewer sampling steps. As a MOT tracker, the DiffMOT is real-time at 22.7FPS, and also outperforms the state-of-the-art on DanceTrack and SportsMOT datasets with $62.3\%$ and $76.2\%$ in HOTA metrics, respectively. To the best of our knowledge, DiffMOT is the first to introduce a diffusion probabilistic model into the MOT to tackle non-linear motion prediction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑