arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2101.05645cs.RO
收藏

用于人体动作预测的LSTM的包围和特征选择

Ensemble of LSTMs and feature selection for human action prediction

University of Zagreb Faculty of Electrical Engineering and Computing(萨格勒布大学电气工程与计算学院)

Tomislav Petković, Luka Petrović, Ivan Marković, Ivan Petrović

摘要:

随着机器人在人类环境中变得越来越普遍,机器人系统有必要更好地理解和预测人类的行为。然而,这并不是一件容易的事情,有时甚至对我们人类来说也不是,但是基于一组相对结构化的可能行动,适当的线索和正确的模型,这个问题可以通过计算来解决。在本文中,我们提出使用长短期记忆(LSTM)网络的集成来进行人类动作预测。为了训练和评估模型,我们使用了MoGaze数据集-目前最全面的数据集捕捉人体关节和人类凝视的姿势。我们已经彻底分析了MoGaze数据集,并为此任务选择了一组精简的线索。我们的模型可以预测(i)人类将抓住哪些标记的对象,以及(ii)人类将访问哪些宏观位置(例如桌子或架子)。我们已经详尽地评估了所提出的方法,并将其与个人线索基线进行了比较。结果表明,我们的LSTM模型在单个对象拾取准确性方面略优于凝视基线,但在宏观对象预测方面实现了更好的准确性。此外,我们还分析了不使用凝视时的预测准确性,在这种情况下,LSTM模型的表现大大优于最佳单一线索基线

英文摘要:

As robots are becoming more and more ubiquitous in human environments, it will be necessary for robotic systems to better understand and predict human actions. However, this is not an easy task, at times not even for us humans, but based on a relatively structured set of possible actions, appropriate cues, and the right model, this problem can be computationally tackled. In this paper, we propose to use an ensemble of long-short term memory (LSTM) networks for human action prediction. To train and evaluate models, we used the MoGaze dataset - currently the most comprehensive dataset capturing poses of human joints and the human gaze. We have thoroughly analyzed the MoGaze dataset and selected a reduced set of cues for this task. Our model can predict (i) which of the labeled objects the human is going to grasp, and (ii) which of the macro locations the human is going to visit (such as table or shelf). We have exhaustively evaluated the proposed method and compared it to individual cue baselines. The results suggest that our LSTM model slightly outperforms the gaze baseline in single object picking accuracy, but achieves better accuracy in macro object prediction. Furthermore, we have also analyzed the prediction accuracy when the gaze is not used, and in this case, the LSTM model considerably outperformed the best single cue baseline

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑