Fluent and safe interactions of humans and robots require both partners to anticipate the others' actions. A common approach to human intention inference is to model specific trajectories towards known goals with supervised classifiers. However, these approaches do not take possible future movements into account nor do they make use of kinematic cues, such as legible and predictable motion. The bottleneck of these methods is the lack of an accurate model of general human motion. In this work, we present a conditional variational autoencoder that is trained to predict a window of future human motion given a window of past frames. Using skeletal data obtained from RGB depth images, we show how this unsupervised approach can be used for online motion prediction for up to 1660 ms. Additionally, we demonstrate online target prediction within the first 300-500 ms after motion onset without the use of target specific training data. The advantage of our probabilistic approach is the possibility to draw samples of possible future motions. Finally, we investigate how movements and kinematic cues are represented on the learned low dimensional manifold.
Anticipate & Collab: Data-driven Task Anticipation and Knowledge-driven Planning for Human-robot Collaboration
Robotics Research Center, IIIT Hyderabad(IIIT海得拉巴机器人研究中心);TCS Research, Tata Consultancy Services(塔塔咨询服务公司TCS研究院);School of Informatics, University of Edinburgh(爱丁堡大学信息学院)
World-to-Wrist: Task-Conditioned Future Wrist Modeling for Fine-Grained Robot Manipulation
The Hong Kong University of Science and Technology(香港科技大学);National University of Singapore(新加坡国立大学);Nanyang Technological University(南洋理工大学);Wuhan University(武汉大学);Sun Yat-sen University(中山大学);Xidian University(西安电子科技大学);Southeast University(东南大学)