arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.14532cs.LGeess.SP
收藏

基于不确定性的雷达鲁棒跟踪Meta-强化学习

Uncertainty-based Meta-Reinforcement Learning for Robust Radar Tracking

Infineon Technologies AG(英飞凌科技股份公司);Technichal University of Munich(慕尼黑工业大学)

Julius Ott, Lorenzo Servadei, Gianfranco Mauro, Thomas Stadelmayer, Avik Santra, Robert Wille

摘要:

如今,深度学习(DL)方法往往克服了传统信号处理方法的局限性。然而,DL方法在实际应用中几乎没有应用。这主要是由于有限的鲁棒性和训练数据与测试数据之间的分布偏移。为此,最近的工作提出了不确定性机制来提高其可靠性。此外,元学习旨在提高DL模型的泛化能力。利用这一点,本文提出了一种基于不确定性的Meta-强化学习(Meta-RL)方法与分布外(OOD)检测。所提出的方法在看不见的环境中执行给定的任务,并提供有关其复杂性的信息。这是通过确定估计奖励的一阶和二阶统计量来完成的。使用有关其复杂性的信息,所提出的算法能够指出何时跟踪是可靠的。为了评估所提出的方法,我们基准它的雷达跟踪数据集。在那里,我们表明,我们的方法在看不见的跟踪场景中的峰值性能比相关的Meta-RL方法高出16%,基线性能高出35%,而检测OOD数据的F1分数为72%。这表明我们的方法对环境变化具有鲁棒性,并可靠地检测OOD场景。

英文摘要:

Nowadays, Deep Learning (DL) methods often overcome the limitations of traditional signal processing approaches. Nevertheless, DL methods are barely applied in real-life applications. This is mainly due to limited robustness and distributional shift between training and test data. To this end, recent work has proposed uncertainty mechanisms to increase their reliability. Besides, meta-learning aims at improving the generalization capability of DL models. By taking advantage of that, this paper proposes an uncertainty-based Meta-Reinforcement Learning (Meta-RL) approach with Out-of-Distribution (OOD) detection. The presented method performs a given task in unseen environments and provides information about its complexity. This is done by determining first and second-order statistics on the estimated reward. Using information about its complexity, the proposed algorithm is able to point out when tracking is reliable. To evaluate the proposed method, we benchmark it on a radar-tracking dataset. There, we show that our method outperforms related Meta-RL approaches on unseen tracking scenarios in peak performance by 16% and the baseline by 35% while detecting OOD data with an F1-Score of 72%. This shows that our method is robust to environmental changes and reliably detects OOD scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑